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Message from the lecturer 



Acknowledgement 

These lectures have been developed by a number of lecturers over the years. I would 
particularly like to thank Professor Roger Heath-Brown who gave the first lectures for 
this course in its present form in 2003 and Dr Brian Stewart and Dr Zhongmin Qian 
who allowed me to adapt their lecture notes and use their KTgX files. 

Lectures 

To get the most out of the course you must attend the lectures. There will be more 
explanation in the lectures than there is in the notes. 

On the other hand I will not put everything on the board which is in the printed notes. 
In some places I have put in extra examples which I will not have time to demonstrate 
in the lectures. There is also some extra material (which is generally in a smaller font) 
which I have put in for interest but which I do not regard as central to the course. 



Numbering system: 

In the printed notes there are 16 sections. Within each section there are subsections. 
Theorems, definitions, etc are numbered consecutively within each section. So for 
example Theorem 1.3 is the third result in Section 1. I will use the numbering in 
the printed notes, even though I will omit some subsections in the lectures, so the 
numbering will no longer be consecutive. 



Exercise sheets 

The weekly problem sheets which accompany the lectures are an integral part of the 
course. In Analysis above all you will only understand the definitions and theorems 
by using them. 

I assume that week 1 tutorials are being devoted to the final sheets from the Michaelmas 
Term courses. 

I suggest that the problem sheets for this course are tackled in tutorials in weeks 2-8, 
with the 8th sheet used a vacation work for a tutorial in the first week of Trinity Term. 

Corrections 

Please email any corrections to me at Janet.Dyson@mansfield.ox.ac.uk 
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Notation: 

I will use this notation (which was used in courses on MT) throughout. 

• C: set of all complex numbers - the complex plane. 

• R: set of all real numbers - the real line; RcC. 

• Q: the rational numbers; QcR. 

• N: the natural numbers, 1,2,...; ff CQ. 

• V: "for all" or "for every" or "whenever". 

• 3: "there exist (s)" or "there is (are)". 

• Sometimes I will write "s. t." for "such that" , "resp." for "respectively", "iff" 
"if and only if". 

Recall the following definition from 'Introduction to Pure Mathematics' last term 
If a, b e R then we define intervals as follows: 



(a,b) 
[a,b] 
(—00, a) 



{x E R : a < x < b} 
{x E R : a < x < b} 
{x e R : x < a}, 



etc. 



1 Limits of Functions 



1.1 Sequence limits and completeness 

This course builds on the ideas from Analysis I and also uses many of the results from 
that course. I have put some of the most important results from Analysis I in these 
notes but I will not write them on the board in the lecture. However, I will begin by 
recalling the definition of limits for sequences. 

Definition 1.1. A sequence (z n ) of real (or complex) numbers has limit I, if 

Ve > 0, 3N G N, such that Vn > JV 

\z n -l\<£. 

We denote this by 'z n — >■ I as n — >■ oo ' or by lim^oo z n — I'. 

Definition 1.2. A sequence (z n ) of real (or complex) numbers converges if it has a 
limit I. 

Often we prove things by contradiction. We start by assuming that what we want 
is not true. That means we have to be able to write down the contrapositive of a 
proposition. We can do this mechanically: working from the left change every V into 
3, every 3 into V and negate the simple proposition at the end. 

For example, by the first definition, a sequence (z n ) does not converge to I 1 , if and 
only if 3e > 0, such that V/c G N, 3n^ > k such that 



Definition 1.3. (z n ) is called a Cauchy sequence if We > 3iV G N such that 
Vn,m > N 

Here is the key theorem, sometimes called The General Principle for Conver- 
gence: 

Theorem (Cauchy's Criterion). A sequence (z n ) of real (or complex) numbers con- 
verges if and only if it is a Cauchy sequence. 

When mathematicians say that the real number system R and the complex number 
system C are complete what they mean is that this theorem is true. There are no 
sequences which look as though they converge but don't, there are no 'gaps' in the 
real number line. 

1 i.e. either (z n ) diverges, or z n — > a ^ I 
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According to Cauchy's criterion, (z n ) diverges [i.e. has no finite limit], if and only 
if 3e > 0, such that Vfc G N, there exist [at least] two integers n^, rik 2 > k s. t. 

\ Z n kl ~ z n k2 | ^ £■ 

The following theorem demonstrates the "compactness" of a bounded subset. 

Theorem. (The Bolzano-Weierstrass Theorem) Any bounded sequence in R 
(or in C) has a subsequence which converges to a point in R (in C). 



1.2 Limit points 

We want to define what is meant by the limit of a function. Intuitively / has a limit I 
at the point p if the values of f(x) are close to / when x is close to (but not equal to) 
p. But for the definition of limit to be meaningful it is necessary that / is defined at 
'enough' points close to p. So we are interested only in points p that x can get close 
to. Such points are limit points of the domain of /. 

Definition 1.4. Let E C R (or C). A point p G R (or C) is called a limit point (or 
an accumulation point) of E, i/Ve > ; there exists z G E such that 

< \z — p\ < e. 

Note that p need not be in E. 

Definition 1.5. A point which is not a limit point of E is called an isolated point 
ofE. 

The following gives a useful equivalent definition of limit point in terms of limits of 
sequences. 

Theorem 1.1. A point p G R is a limit point of E C R if and only if there exists a 
sequence (p n ) in E s.t. lim^ooPn = p and p n ^ p, Vn G N. 

Proof: See problem sheet 1. 

There are all sorts of exotic examples of limit points but most sets we will consider are 
intervals so the following result is crucial: 

Theorem 1.2. p G R is a limit point of an interval (a, b) (or (a, b], or [a, b) or [a, b}) 
if and only if p G [a, b] . 

Proof. There are (by trichotomy) only three cases: p < a, p G [a, b], and p > b. In the 
first take e := (a — p)/2 and get a contradiction, in the third take e := (p — b)/2. If 
p G [a, b), given e > choose x = p + \ min{e, {b — p)}. The case p = b is similar. □ 
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1.3 Functions 



Let / : X — > Y, where X and Y are subsets of C or ffiL 

Although there's no such thing a typical function here are three examples, which are 
often useful as test cases when we formulate definitions and make conjectures. 

Example 1.1. f(x) = y/l — x 2 with domain E — [—1,1]. What is its graph? Its graph 
looks continuous .... 

Example 1.2. Consider function f on E = (0, 1] given by 

{- if x — - in lowest terms, 
when x is irrational. 
This time our sketch of the graph is a bit more sketchy. [Try with MuPAD]. 

Remember that any nonempty interval contains both rational and irrational numbers. 
Intuitively f(x) — > as x — > but the limit does not exist at any other point. 

Example 1.3. The function f(x) = xsin| with domain M\{0} is an important test 
case. As x gets close to 0, the values of f oscillate, but they do get close to 0. We will 
see that f has limit as x goes to 0. 

1.4 Limits of Functions 

Having looked at these examples we make a definition. 

Definition 1.6. Let E C H. (or C), and f : E — > R (or C) be a real (or complex) 
function. Let p be a limit point of E and let I be a number. We say that f tends to 
I as x tends topif\fe> 35 >0 such that \/x E E such that < \x — p\ < 5 

\f(x)-l\<e . 

In symbols we write this as lirn^p f(x) = V or 'f(x) — > I as x — >■ p.' 
Remark 1.3. (i) Note that p is not necessarily in E. 
(ii) Note that in the definition 5 may depend on p and e. 

Example 1.4. Let a > 0. Consider the function f(x) = |x| a sin^ on the domain 
E = R\{0}. Show that f{x) ^ as x 0. 

Since |sin#| ^ 1 we have that |a; a sin|| < \x\ a for any x ^ 0. Therefore, V e > 0, 
choose 5 = e l l a . Then 

< \x\ a < e whenever < \x — 0| < 5. 
According to the definition, b| a sin - — >• as x — > 0. 
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x a sin - - 

x 



Example 1.5. Consider the function f(x) = x 2 on the domain E = R. Let a G R. 
STiou; i/ioi /(rr) — >■ a 2 as x — > a. 

Note that \x 2 — a 2 \ = \x — a\\x + a\ < \x — a\(\x\ + \a\). So we want to get a bound on 
x. Suppose that \x — a\ < 1, then 

|x| = \x — a + a\ < \x — a\ + \a\ < 1 + \a\. 
So Ve > 0, choose 8 = min{l, 1+ e 2 \ a \ }• Then 

\x 2 — a 2 \ < \x — a\((l + \a\) + \a\) < e whenever \x — a\ < 5 

as required. 

Theorem 1.4. Let f : E — >■ R (or C) and p be a limit point of E. If f has a limit as 
x — > p, then the limit is unique. 

Proof. Suppose f(x) — > l\ and also f(x) — >■ li as x — > p, where l\ ^ l-i. Then 
— Za | > 0, so by definition, 38i > such that Wx G E such that < \x — p\ < 5± 

\f(x)-h\ < 

Similarly, 3^2 > such that Vrr G E such that < \x — p\ < 82 

\f(x)-l 2 \ < \\h-l 2 \. 

Let 5 = min{5i, 82}. Since p is a limit point of E and 8 > 0, 3x G -B such that 
< \xo — p\ < 8. However 

I Zx — Z 2 1 = \(f( x o) ~ h) — (f( x o) — h)\ [Add and subtract technique] 

^ \f(x ) -h\ + \f(x ) - k\ [Triangle Law] 
< — ^| + \\h — h\ 

— I Z x — h\ 

a contradiction. □ 

Remark 1.5. An exercise in contrapositives: f doesn't converge to I as x — >■ p (i.e. 

either f has no limit or f{x) — > a 7^ / as x — > p), means that 

3e > 0, such that V<5 > ; 3x G E such that < \x — p\ < 8 but \ f(x) — l\ ^ e. 

The following theorem translates questions about function limits to questions about 
sequence limits, and so we can make use of results in Analysis I. For example we 
will be able to deduce an algebra of limits for functions from the algebra of limits for 
sequences. 

Theorem 1.6. Let f : E ->■ R (or C) where E C R (or C), p be a limit point of E 
and I G C. Then the following two statements are equivalent: 
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(a) f(x) — >■ I as x — >■ p; 

(b) For every sequence (p n ) in E such that p n ^ p and lim^oo p n = p we have that 

fiPn) — > I as n — > 00 ■ 

Informally f(x) — > I as x — > p if and only if / tends to the same limit / along any 
sequence in E going to p. 

Proof. =>: Suppose lim x _» p /(x) = I. Then Ve > 0, 35 > such that Vx E E such 
that < \x — p\ < 5 

\f(x)-l\<e. 

Now suppose (p n ) is a sequence in E 1 , with p n — >■ p and p n 7^ p. Then 3iV e N such 
that Vn > iV 

\p n -p\<5. 

So, since p n p, Vn > N 

\f(p n )-l\ < e. 

Hence, lim^^ /(p n ) = /. 

•<=: Argue by contradiction. Suppose lim^p /(x) = I is not true. Then 
3^0 > 0, such that V5 > 0, — which we choose to be l/n for arbitrary n — 3x n G E, 
with < \x n — p\ < l/n but 

\f(Xn) E . 

Therefore we have found a sequence (x n ) which converges to p but (/ (x n )) does not 
tend to I. Contradiction. □ 

The above result is very useful when we want to prove that limits do not exist. 
Example 1.6. Show that lim x _y sin | doesn't exist. 

Let x n = — and y n = . Then both sequences x n and y n tend to 0, but 

Tin 2nn + | 

lim sin — =0 

n-*-oo X n 

and 

lim sin — = 1. 

n-^oo y n 

So lim^o sin - cannot exist. 
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1.5 Algebra of Limits 

We can use the theorem of the previous subsection together with the Algebra of Limits 
of Sequences to prove the corresponding results: we get the Algebra of Limits of 
Functions. We state the theorem for C but it also holds for ffiL 

Theorem 1.7. Let E C C and let p be a limit point of E. Let f,g:E-$C, and let 
a, (3 E C. Suppose that f(x) — > A, g(x) — > B as x — >■ p. Then the following limits 
exist and have the values stated: 

(Linear Combination) lim x _» p (a ■ f + /3 ■ g) (x) — aA + j3B; 
(Product) ]im x ^ p (f(x)g(x)) = AB; 

(Quotient) if B ^ then 35 > s.t. g(x) ^ \/x e E such that < \x - p\ < 5, 
and lim^p (f(x)/g(x)) = A/B; 

(Weak Inequality) if f(x) ^0 for all x E E then A ^ 0. 

Proof. These can all be deduced directly from the Algebra of Limits of Sequences 
using Theorem 1.6, or they can be proved directly from the definitions (just mimic the 
sequence proofs). 

Some examples: 

Direct proof of product result: Note 

\f(x)g(x) - AB\ < \f(x)\\(g(x) - B)\ + \B\\{f{x) - A)\, 

so we need to bound \ f(x)\. But 35i > s.t. Vx E E such that < \x — p\ < S± : 
\f(x)-A\ < 1. So 

\f(x)\<\f(x)-A\ + \A\<l + \A\. 
Now given e > 0, 35 2 > such that \fx E E such that < \x — p\ < 5 2 

and 3^3 > such that Vrr E E such that < \x — p\ < 63 

Thus, taking 5 = min{5i, 5 2 , 83}, Va; E E such that < \x — p\ < 5 

\f(x)g(x) - AB\ < (l + \A\)\g(x)-B\ + \B\\f(x)-A\<e. 

To prove: //B^O then 35 > s.t. g{x) 7^ \fx E E such that < \x — p\ < 5, and 
lim^p (l/g(x)) = l/B; 
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I will do it both ways: 

(i) Deduction from AOL for sequences: Suppose first that there is no such 8. Then for 
each n, 3p n G E such that < \p n — p\ < 1/n, and g(p n ) = 0. But then p n — > p, so 
9(Pn) —> B, giving B = 0, a contradiction. So 8 > exists. 

Now let (x n ) be any sequence in E with x n — > p and x n ^ p. We may assume 
x n G (p — 8,p + 8) (by tails). Hence g(x n ) ^ and g(x n ) — > B. Thus by the AOL for 
sequences, l/g(x n ) — > 1/B. Thus, by Theorem 1.6, l/g(x) — > 1/B as required. 

(ii) Direct proof: Take e = \B\/2 > 0. So 35i > such that Vrr G E such that 
< \x — p\ < 5i 

\g(x)-B\ < \B\/2. 
Thus by the Triangle Law \/x G E such that < \x — p\ < 5i 

\g(x)\ = \B + (g(x) - B)\ > \B\ - \g(x) - B\ > \B\ - \B\/2 = \B\/2. 

(So in particular, g(x) ^ whenever < \x — p\ < Si.) 

Now, given e > 0, 3^2 > such that Vrr G E such that < \x — p\ < 82 

\g{x) -B\< \B\ 2 e/2. 

Take 8 = min{<5i, 82). Then if x G E is such that < \x — p\ < 8 

\ 1 / \ , /„, \g(x)-B\ \B\ 2 e/2 

as required. □ 

Corollary 1.8. Note we have also proved above that if lim x ^ p g(x) = B 7^ 0, then 
there is a positive number 8 > such that 

\B\ 

\9( x )\ ^ Vx E E such that < \x — p\ < 8. 

In particular, \g(x)\ > G E such that < \x — p\ < 8. 

It can be proved similarly that if g : E — >■ R and B > 0, then 38 > snc/i i/iai 
5f(x) > f > Vrr G E such that < \x - p\ < S. 

The following is a version of the sandwich theorem. 

Proposition 1.9. Let E C 1R. and Zei p be a limit point of E. Let f, m, M : E — > R. 
Suppose that there exists 8 > s.t. m(x) < f(x) < M(x) for all x G E such that 
< \x — p\ < 8 and that m(x) — > I, M(x) — >■ I as x — >■ p. T/ien lim x _^ p /(a;) exisis and 
equals I. 

For proof see problem sheet 1. 
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1.6 An extension 



Sometimes we want to extend the notion 1 }\x) — > £ as x — > p' to cover 'infinity'. Here is 
one such extension: note that although oo appears in the language, we have not given 
it the status of a number: it can only appear in certain phrases in our mathematical 
language which are shorthand for quite complicated statements about real numbers. 

Definition 1.7. Suppose that E CI is a set which is unbounded above and f : E — >■ R. 

Then we write f(x) — > oo as x — > oo to mean that: 
VB > 0, 3D > such that Vrr e E such that x > D 



2 Continuity of functions 

We all have a good informal idea of what it means to say that a function has a 
continuous graph: we can draw it without lifting the pencil from the paper. But we 
want now to use our precise definition of l f(x) — > I as x — > p' to discuss the idea of 
continuity. That is we want to discuss the precise question of whether / is continuous 
at a particular point p. 

2.1 Definition 

In the definition of \im x ^. p f (x) , the point p need not belong to the domain E of /. 
But even if it does, and f(p) is well-defined, the limit of / at p may not be f(p). 

The classic example is the function 



Then linx^o f(x) = ^ 1. 

This example motivates our definition. 

Definition 2.1. Let f : E ->■ R (or C), where E C R (or C), and p E E. We say 
that f is continuous atpifVe> 35 >0 such that Vx £ E such that \x — p\ < 5 



We continue with the notation of the definition for a moment and see what this means 
for isolated and limit points. 

Proposition 2.1. / is continuous at any isolated point of E. 



f(x) > B. 




otherwise. 



\f(x)-f(p)\<e. 
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Proof. As p is isolated there exists 5 > such that there are no other points of x £ E 
such that < \x — p\ < 5. The inequality required is therefore vacuously true. □ 

Proposition 2.2. If p G E is a limit point of E, then f is continuous at p, if and 
only if 

lim/(x) exists and lim f(x) = f(p). 

Proof. It's clear that the continuity definition implies the limit one at once. The limit 
one, provided the limit is f(p), delivers all that we need for continuity except that the 
inequality \f(x) — l\ < e holds for x = p as well as the other points x in \x — p\ < 5. 
But this is immediate. □ 



The following theorem follows immediately from Proposition 2.2 and the proof of 
Theorem 1.6. In this case we do not need to avoid sequences which hit the point: 

Theorem. 1.6'. Let f : E ->■ R (or C) where E C R (or C) and p E E. Then the 
following two statements are equivalent: 

(a) f(x) is continuous at p; 

(b) For every sequence (p n ) in E such that lim^ooPn = p we have that f{p n ) —> f(p) 

as n — > oo. 



2.2 Examples 

Example 2.1. Let a > 0. The function f(x) = |x| Q sin^ not defined at x = so it 
makes no sense to ask if it is continuous there. In such circumstances we modify f in 
some suitable way. So we look at 



g(x) :-- 



\x\ a sin - i/i^O, 
ifx = 0. 



Then is a limit point of the domain, and we calculated before that lim^o g(x) = = 
g(0), so g is continuous at 0. 

Example 2.2. Let f : (0, 1] ->■ R be defined by 

- if x = — in lowest terms, 



1 if x is irrational. 

At which points of (0, 1] is f continuous? 
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This is very like problem on the Exercise Sheets, so I won't give a full proof here, only 
indicate how I would tackle it. 

Every p G (0, 1] is a limit point, so we need to work out lim x ^ p f(x) for each p. We 
know that we can do this by looking at lim^oo f{p n ) for each sequence (p n ) converging 
to p. 

We know that there is always a sequence of irrationals (x n ) converging to p. (Because, 
from Analysis I, for every n G N the interval (p,p+l/n) contains an irrational number 
x n .) Then the sequence (f(x n )) is just the null sequence (0,0, ... ) with limit 0. 

So it looks as if we should distinguish between rational and irrational points. 

Suppose p 7^ is rational. Then, with (x n ) as above, f(x n ) — > but f(p) ^ 0. 
Therefore / is not continuous at non-zero rational points, by Theorem 1.6. 

Now let p be irrational. Some sequences (for example irrational ones) tend to = f(p). 
But do all sequences have this property? Let (p n ) be any sequence in (0, 1] tending to 
p and consider f(p n ). If this does not tend to zero, then for some e > we can find a 
subsequence such that f(p n ) > £■ That is, these p n . must be rational and if p n . = — 

in lowest terms then, as f(p nj ) = the denominator q nj < K There are only a finite 

number of such points in the interval, so there exists 5 > such that there are no 
such points in the interval (p — 5, p + 5) . Thus — since p nj — > p — we cannot have the 
claimed subsequence. 

Therefore / is continuous at irrational points since for all sequences (p n ) we have that 

hi',) •>./(/<!• □ 



2.3 Algebraic properties 

We can use our characterisation of continuity at limit points in terms of linx^p f(x) 
together with the Algebra of Function Limits to prove that the class of functions 
continuous at p is closed under all the usual operations. We state the theorem for C 
but it also holds for R. 

Theorem 2.3. Let E C C and let p G E. Let f,g:E—*C, and let a, (3 G C. Suppose 
that f,g are continuous at p. Then the following functions are also continuous at p: 

(Linear Combination) (a ■ f + (5 ■ g) (x); 
(Product) (f(x)g(x)); and 

(Quotient) (f(x)/g(x)) provided g(p) ^ (which guarantees that there exists 5 such 
that f(x)/g(x) is defined \/x G E such that \x — p\ < 5). 
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Proof. Follows directly from the Algebra of Function Limits. However, it is a good 2 
exercise to write out a proof from the definition — again just mimic what was done for 
the AOL for sequences. □ 



Example 2.3. Let f : C — >■ C (orM,— > M.) be a polynomial. Then f is continuous at 
every point of C (orM.). 

Further, if f(x) = where r, q : C — > C (or R — > M) are polynomials. Then if 

q(p) 7^ 0, / is continuous at p. 

This follows immediately from the above theorem because the function f(x) = x with 
domain C (or R) is continuous. 

2.4 Composition of continuous functions 

However we can do more than these trivial algebraic results. 

Theorem 2.4. Let f : E ->■ C and g : f\E) ->■ C, and define h : E ->■ C by 

h(x) = (gof)(x) :=g(f(x)) for x EE. 
If f is continuous at p e E and g is continuous at f{p), then h is continuous at p. 

Proof. For any e > 0, since g is continuous at f(p), 35i > such that G /(-E 1 ) such 
that \y- f(p)\ < 5 1 

\g(y) - g(f(p))\ < e. 

That isVx eE such that \f(x)-f(p)\< Si 

\g(f(x))-g(f( P ))\<e. 
However, / is continuous at p, so 35 > such that Vx G E such that \x — p\ < 5 

\f(x)-f(p)\<5 1 . 
Hence Vx G E such that |x — _p| < 5 

\g(f(x))-g(f(p))\<e 

so that h is continuous at p. □ 
2 Doing this will reinforce the definitions, but also consolidate your understanding of sequences. 
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2.5 More examples of continuous functions. 

Recall from Analysis I that the functions from C — > C (or R — >■ R), exp(x), sin(x), 
cos(a;), sinh(x) and cosh(x) etc are defined by their power series, each of which has 
infinite radius of convergence. Later we will see that a power series is continuous within 
its radius of convergence, so each of these functions is continuous everywhere and, for 
now, we will assume this. We can now use the algebra of continuous functions and 
the composition of continuous functions to prove the continuity of a wide variety of 
functions. 

Example 2.4. The function g : R — > R 



is continuous at every point of R. 

Proof We have already proved that g is continuous at 0. 

If P 7^ 0-' ^/x is continuous at p as p ^ [Quotient of continuous functions] and 
sin(a;) is continuous at 1/p. Hence sin(l/:r) is continuous at p [Theorem 2.4]- Hence 
xsm(l/x) is continuous at p [Product of continuous functions]. 

3 Continuity and Uniform Continuity 

3.1 Continuous functions on sets 

Having made our definition of 'continuity' we will see that actually, what usually 
matters is not continuity at a point, but continuity at all points of a set, and the 
interesting sets are usually intervals or disks. In the later lectures we are going to 
establish several important theorems about continuous functions on bounded intervals. 

But here is the definition of continuity on a set. 

Definition 3.1. Let f : E — > R (or C). We say that f is continuous on E if f is 

continuous at every point of E. 

For later use we decode this in terms of es and Ss. 

Proposition 3.1. Let f : E — > R (or C). Then f is continuous on E if, 



Note that the 5 may depend on e and on the point p. 

We are about to look at uniform continuity, in which 5 does not depend on p. First 
we will consider an example which is not uniformly continuous. 




zfxj^O, 
ifx = 0. 
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3.2 An Example 

We look at an example of a function continuous on a set. 
Example 3.1. Let f : (0, oo) — > R be given by f(x) := — . 

Ob 

Show that for every p ^ 0, lim x _^ p \ = \> an d thus f(x) is continuous on (0, oo). 

By the algebra of limits this is all clear. But we want to analyse what is going on more 
carefully, to see how the 5 is related to e and the the point x in question. 

First, 

\x — p\ 



\f(x)-f(p)\ 



1 1 

x p 



\x\\p\ 



and we can see that the problem term is — . 

x 

However, \p\ > 0, and so when \x — p\ < \\p\ we have by the Triangle Law that 

\ x \ ^ \p\ ~ \ x ~ p\ > |bl ; 

so we're going to have to pick 8 ^ 
For these x, then, we have that 

2 

\f(x) - f(p)\ ^ —\x-p\ 

and if we make sure ^ \x — p\ <ewe will be done. 
This can be achieved that by choosing 

5 := min ^|p| 2 ) 

which is indeed positive. 

Note that for small e (the interesting ones) the values of S we need depend heavily on 
p. Near 1 choosing \e will do, but at 10~ 6 we need 2 ^ Ql2 e. Our function is certainly 
continuous at every point, but there's no way of controlling over the whole interval 
how far it strays in a small neighbourhood. 

3.3 Uniform Continuity 

Sometimes we want to be able to control what happens over a set more 'uniformly'. 
Definition 3.2. Let f : E — >■ R (or C). Then f is uniformly continuous on E if, 

> ; 35 > such that \/p G E and Wx e E such that \p — x\ < 5 

\f(p)-f(x)\<e . 
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Note the difference 3 between this and the definition of 'continuous on E\ 

In this, the uniform case, 5 can depend only on e and must be independent 

of x and p. (We must be able to choose it 'uniformly'.) Obviously if we can do this 
it is very nice, it gives us a way of controlling what happens on a set all at once. 

Of course / : E — >■ R (or C) is uniformly continuous on E implies that / is continuous 
on E. 

Here is one class of functions that satisfy the uniform continuity condition. 

Example 3.2. Suppose that f is Lipschitz continuous in E: that is, assume that there 
exists M > such that 

\f(x)-f(y)\^M\x-y\ Vx,y e E. 
Then f is uniformly continuous on E. 

Take x,y E E. Given e > 0, choose 5 = > 0. Then 

l/M- M\ < M\x-y\ 



« "'mTT 1 ' 



whenever \y — x\ < 5. 



Note that our choice of 5 does not depend on x or y. For a given e > we can find 
a 5 that works for all x and y. 

Example 3.3. f(x) = y/x is Lipschitz continuous on [l,oo) ; so it is uniformly con- 
tinuous. 

To see the Lipschitz condition note that 



\Vx-y/y\K: Z , ~ — ^\\x-y\ 



for all x, y ^ 1. 



3.4 Continuity implies Uniform Continuity on [a, b] 

Our first real theorem is: 



3 For those who like pure formulae, 



Continuity on E: Vp e E Ve > 36 > Vx E E [\x - p\ < S \ f(x) - f(p)\ < e] 

Uniform Continuity on E: Ve > 36 > Vp G E Vx e S [|x - p\ < 6 => \f(x) - f(p)\ < e] 

Swapping Vs doesn't give problems, but swapping the Vp and 36 is the crunch. 
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Theorem 3.2 (Uniform Continuity on [a, b]). If f : [a, b] — > R (orC) is continuous, 
then f is uniformly continuous. 



More generally, a continuous function on a closed and bounded set — 'compact set' as 
we'll say next year — is uniformly continuous. 

Proof. Suppose that / were not uniformly continuous. By the contrapositive of 'uni- 
form continuity' there would exist e > 0, such that for any 5 > — which we choose as 
5 = ^ for arbitrary n — there exists a pair of points x n , y n G [a, b], such that 

\x n -y n \<\ but \f(x n ) - f(y n )\ ^ e. 

Since {x n : n G N} C [a, b] is bounded, by the Bolzano- Weierstrass Theorem there 
exists a subsequence (x nk ) which converges to some p. Hence p must be a limit point 
of [a, b], so p G [a, b]. But 

\Un k ~ P\ ^ \ X n k ~ y-n k \ + \ x n k ~ P| 
< — + \x nk ~p\ -> 

Thus x„ fe p and y„ fc — >■ p, so that by continuity at p we have 

< e < |/(x n J - /(y n J| < \f(x nk ) - f(p)\ + \f(y nk ) - f(p)\ -)■ as fc -)• oo, 

by Theorem 1.7 ' (in the case continuous functions we omit the requirement that the 
sequence does not hit p). This gives a contradiction. □ 



3.5 An example on an unbounded interval 

Example 3.4. f(x) = y/x is uniformly continuous in the unbounded interval [0,+oo). 

We do this in three steps: we prove uniform continuity on [0,1], we prove uniform 
continuity on [1, +oo), and we patch these together. 



It is easy to get that yfx is continuous on [0, 1]: Continuity at is easy. Otherwise, 
provided \x — p\ < \p we will get 

i i— i-\ \ x — p\ 2 . 

v x — Jp\ ^ — 1= ^ \x — p\ 

Vx + ^/p 3^/p 

and can argue from there. Thus it must be uniformly continuous by Theorem 3.2. 

Secondly we have already shown that y/x is Lipschitz continuous on [l,oo), so it is 
uniformly continuous on [1, oo). 

Now we have to patch these together. This is a standard sort of argument which we 
do this time as an example. 
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We have that for all e > 0, 35 1 > such that Vx, y G [0, 1] such that |x — y\ < 5i 

\Vx- y/y\ < \e 
and 35 2 > such that Vx, y G [1, oo) such that |x — y| < 52 

Vv\< §e- 

Choose 5 = min{5i,<5 2 } > 0. Then, suppose that |x — y\ < 5. If x, y ^ 1 or x, y ^ 1 
we are done. 

So suppose that x G [0, 1] and y ^ 1. Then |x — 1| < 5 and |y — 1| < 5 so that 

Iv^-v^l < | v ^-v / i| + IVj/-v / T| 

< \e +\e = e 

Hence we have 

whenever x, y G [0, oo) such that |x — y\ < 5. By definition, /(x) = is uniformly 
continuous in the unbounded interval [0, +oo). 

3.6 A counterexample on a half open interval 

The condition that the interval [a, b] is closed cannot be relaxed. 

Example 3.5. /(x) = | is not uniformly continuous in the half open interval (0, 1]. 
(see also Example 3.2.1) 

Take e — 1. We show that there is no 5 > such that definition 3.3.1 holds. 

Take sequences x n = \ and y n = Then |/(x„) - /(y„)| = 1, but |x n - y n | ->■ 0. 
So for any 5 > 0, there exists n such that |x n — y n \ < 5 but |/(x n ) — /(y n )| ^ 1- So / 
is not uniformly continuous. 

4 Continuous functions on a closed and bounded 
interval 

4.1 Boundedness 

We begin with some definitions. 

Definition 4.1. Let f : E ->■ R for Cj. We say /nai / zs bounded on E if 3M > 

sitca taat Wz E E 

l/Wia . 

We a/so say t/iat / is bounded by M on E and M is a bound for f on E. 



20 



Here is one of the central theorems of the course: 



Theorem 4.1 (Continuous functions on [a, b] are bounded). If f : [a, b] — > R 

(or C) is continuous, then f is bounded. 

Proof. Argue by contradiction. Suppose / were unbounded, then for any n G N, there 
exists x n G [a, b] such that \f(x n )\ ^ n. Since (x n ) is bounded, by the Bolzano- 
Weierstrass Theorem, there exists a subsequence (x nk ) converging to p, say. Then p 
is a limit point of the interval [a, b] so p G [a, b]. Now / is continuous at p and so we 
have that 

f(p) = lim f(x nk ) 

so in particular the sequence (f(x nk )) is convergent. Hence, by an Analysis I result, 
this sequence is bounded. But \f(x nk )\ ^ n k ^ k. so this is a contradiction. 

Therefore / must be bounded. □ 

Example: The function f(x) = | is continuous but not bounded on (0,1], so the 
condition that the interval is closed is required. 

We will now show that these bounds are 'attained'. 

Notation 4.2. Let f : E — > R be a bounded real-valued function, with E ^ 0. Then 
write 

sup /(:r) := sup{/(t) | t G E} 

x€E 

mff(x) :=inf{/(t) \ t E E} 

x£E 



noting that these exist by the Completeness Axiom. 

Corollary 4.2. Let f : [a, b] — > R be continuous then sup xg [ 0jb ] f(x) and inf^^] f(x) 
exist. 

Proof. Immediate. □ 

Note 4.3. Recall that the supremum is precisely this: an upper bound, such that 
nothing smaller is an upper bound. It is convenient to translate this into e-language 
about functions as follows: 

, , s ., _, , ., f Vrr G E, fix) ^ M; and 

M = sup fix) if and only if < w . _, ' , ^ ^ „, , , . 

xg E V y ^ y ^ \ Ve > 3x e G £ such that f(x £ ) > M - e. 

We have a similar characterisation of infimum: 

f, r / \ , , .„ f Wx G E, fix) ^ m; and 

m = mt r x ana on/y if < w _ _. _ , ^ ^ <•/ \ 

zg^T v 7 ^ y J [ We > 3x e e E such that f(x £ ) <m + e. 
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Here now is our second important theorem; note that it is only for real- valued functions. 

Theorem 4.4 (Continuous functions on [a, b] attain their bounds). Let f : 

[a, b] — > K. be continuous, then f attains (or achieves) its supremum and infimum. 
That is, there exist points 4 " x\ and xi in [a,b] such that f(xi) = sup x6 [ 0j6 ] f(x) and 
f(x 2 ) = infxe[a,6] f(x). 

Proof. (1st Proof: by contradiction.) Let us prove by contradiction that the supremum 
M of / is attained. 

Assume the contrary, that is 

f(t)<M for all t G [a, b]. 
Consider the function g defined on [a, b] by 

g(x) 



M-f(x) 



which is positive and continuous on [a, b]. Therefore g is, as we have proved, bounded 
on [a, b], by M say: 

It follows that 

for all x G [a, b] which is a contradiction to the fact that M is the least upper bound. 

A similar argument deals with the infimum, or apply what we have done to — / and 
get the result at once since 

inf{f | t G E} = - sup{-t \ te E}. 

□ 

As this is such an important theorem we give an alternative proof. 

Proof. (2nd Proof: sequence argument.) The continuous function / is bounded by 
our earlier theorem, so that M := sup x6 [ aj6 ] f(x) exists by the Completeness Axiom of 
the real number system [Analysis I] . Apply the characterisation of supremum we have 
given, taking e := \ to find a point x n G [a, b] such that 

M - \ < f(x n ) < M. 



l Note that x\, X2 may be not unique. 
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Since (x n ) is bounded, by the Bolzano- Weierstrass Theorem there exists a subsequence 
(x nk ) converging to p, say. Then p is a limit point of [a, b] so p G [a, b}. Since / is 
continuous at p, we have that f(x nk ) — >■ /(p). But from the inequality 

M- — </(x n J 

we can deduce from the sandwich theorem that f(x nk ) — > M as /c — > oo. Hence, by 
the uniqueness of limits, f{p) = M = sup x6 [ aj6 ] f(x). 

A similar argument will deal with the infimum. □ 

Example: Consider the function f(x) = x 2 for x G (0,1]. On (0,1] this is bounded 
and attains it supremum, but does not attain its infimum. 



4.2 A Generalisation 

In the proofs we have used only: 

(i) [a, b] is bounded; 

(ii) [a, b] is closed (i.e. [a, b] contains all limit points of [a, b]; 

(iii) / is continuous. 

This prompts us to make the following definition: 

Definition 4.3. A subset A of K. (or of C) is compact if it is bounded, and if it 
contains all its limit points. 

Our proofs would then give the more general result: 

Theorem. Let f : E — >■ R be a continuous real valued function on a compact subset 
E o/R or C. Then f is bounded, uniformly continuous, and attains its bounds. 
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5 The Intermediate Value Theorem 



So far we have concentrated on extreme values, the supremum and the infimum. What 
can we say about possible values between these? 

Theorem 5.1 (IVT). Let f : [a, b] — > R be continuous, and let c be a number between 
f(a) and f(b). Then there is at least one £ G [a, b] such that /(£) = c. 

This is one of the most important theorems in this course. 

Proof. By considering — / instead of / if necessary, we may assume that f(a) ^ c ^ 
fib). The cases c — f(a) and c = f(b) are trivial, so assume f(a)<c<f(b). 

Define g(x) = f(x) — c. Then g(a) < < g(b). Hence it is sufficient to prove that if 
g : [a, b] — > R is continuous and g(a) < < g(b), then there exists £ G (a, b) such that 
9(0 = 0. 

Define E = {x G [a, b] : g(x) < 0}. 

Then, a G E so E ^ and i? is bounded by b. So, by the Completeness Axiom, 
£ = sup E exists. Since a G E we have £ = sup E > a and since 6 is an upper bound 
for E we have £ = supi? < b. We now prove, by contradiction, that g{£) = 0. 

Suppose first that g(£) < (so £ G [a, 6)). Let £ = — > 0. Then 35 > such that 
if x G [a, 6] and \x — £| < <5 then |<7(x) — <?(£)! < 6 an d hence g(:r) < + £ = 0. Thus 
[£, min{£ + <5, 6}) C E 1 , which contradicts that £ = sup E since there exists x E E such 
that x > £. 

Suppose now that y(£) > (so £ G (a, 6]). Let e = (?(£)> 0. Then 35 > such that if 
x G [a, b] and |x — £| < 5 then — g(£)\ < £ and hence g(x) > g(£) — e = 0. Thus 
(max{a,£ — 5},£] fl = 0, which contradicts that £ = supi? since there is no x G E 
such that x > max{a, £ — 5}. 

Hence g(£) = as required. It is now clear that £ G (a,b). □ 

Remark 5.2. TTie proo/ o/ IVT requires more than what we needed for boundedness 
and the attainment of bounds. We have used the fact that [a, b] is unbroken. That is, 
we have used the fact that [a, b] is "connected" . 

This proof may seem familiar from Analysis I, where a proof similar to this was used 
to prove the existence of y/2. In fact we can now prove this directly from the IVT. 

Example 5.1. There exists a unique positive number £ s.t. £ 2 = 2. 

Proof: Consider f(x) = x 2 - 2. Note that /(0) = -2 and f(2) = 2. So f : [0, 2] ->■ R, 
/(0) < < /(2) and also, as f is a polynomial, it is continuous. Thus, by the IVT, 
there exists £ G (0,2) such that /(£) = 0, as required. Uniqueness can be proved as in 
Analysis I. 
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More generally the IVT is often used to show that algebraic equations have solutions. 
In the following, if you draw the graphs of y = e x and y = ax, you will see that if a = e 
the curves touch, if a < e they do not meet, but if a > e then they meet twice. The 
following example shows how to make this graphical argument rigorous using the IVT. 
It shows that if a > e there exist two solutions. Once we have covered differentiability 
you will be able to prove that there are exactly two solutions, by using the fact that 
f'(x) < if x < log a, but f'(x) > if x > log a. 

Example 5.2. Let a > e. Show that there exist two distinct points Xi > 0, i = 1,2, 
such that e Xi = axi. 

Proof: Consider f(x) = e x — ax. We will prove later that for all x, e x is continuous. 
Hence f(x) is continuous on [0, oo). e x is defined by its power series so that e x > x j. 
Thus e x > aX for any X > 2a. Fix such an X (> \oga). 

Then /(0) = 1 > 0, /(log a) = a(l - log a) < 0, f{X) > 0. So we can apply the IVT 
to the two intervals [0, loga], and [log a, X] to find that there exist x\ G [0,loga] such 
that f(xi) = 0, and x 2 G [loga, JT] such that f(x 2 ) = as required. 

Here (for interest) is a sketch of an alternative proof, which identifies £ by repeated 
bisection. 

Alternative proof to IVT. By considering — / instead of / if necessary, we may 
assume that f(a)^c^f(b). The cases c = f(a) and c = f(b) are trivial, so assume 
f(a)<c<f(b). 

Define g(x) = f(x) — c. Then g(a) < < g(b). 

Let Xi — a and y 1 = b. Divide the interval into two equal parts. 

If g{\{xi + yi)) = then £ := \(xi + yi) will do. 

Otherwise, if ^(K^i + yi)) > 0, we choose x 2 = x\ and y 2 = {\{x\ + yi), 
or, if g{\{x\ + yi)) < 0, we choose x 2 = \{xi + yi) and y 2 = y 1 . 
Then 

g(x 2 )g(y 2 ) < 0; [x 2 ,y 2 ] C and \y 2 - x 2 \ = \{y x - x x ) . 

Apply the same argument to [#2,2/2] instead of [xi,t/i], we then find that: either 
g{\{x 2 + y 2 )) = and we can take £ := \{x 2 + y 2 ), or there exist x 3 , y 3 such that 

9(x 3 )g(y3) < 0; [x 3 ,y 3 ] C [x 2 ,y 2 ]; and \y 3 - x 3 \ = \ (y 2 - x 2 ) . 

By repeating the same procedure, we thus find two sequences x n , y n , such that 

(i) either g(^(x n -i + y n -i)) = and we can take £ 

or g(x n )g(y n ) < 0; 

(ii) [x n , y n ] C [# n _i, y n -i] for any n = 2, . . . ; 

(iii) \y n - x n \ = l\y n -i - #«-i| = • • • = ^\yi - #1 



:= \{x n -i + y n -i), 



b — a 
2 n ~ 1 ' 
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Obviously, (x n ) is a bounded increasing sequence, and (y n ) is a bounded decreasing 
sequence. Bounded monotone sequences converge and so x n — > £ and y n — > £' for some 
£, £' G [a, b}. Since by Algebra of Limits 

|f - f | = lim |y n - x„| = lim (6 - a) = 0, 

n— >oo n— >oo 

we get £ = Since <? is continuous at £, we have by Algebra of Limits and the 
preservation of weak inequalities that 



#(0 2 = lim g( x n) lim g(y n ) = lim g{x n )g{y n ) < 0. 

n— s-oo 



Hence g(£) 2 = as we are dealing with real numbers, so that g(£) = 0. 

That is, /(£) = c. □ 

Remark 5.3. The above proof of the IVT also provides a method of finding roots to 
/(£) = c, but other methods may find roots faster if additional information about f 
(e.g. that f is differentiate) is available. 

Corollary 5.4. Let {[x n ,y n ]) be a decreasing net 5 of closed intervals of R such that 
the length y n — x n — > 0. Then r\™ =1 [x n , y n ] contains exactly one point. 

Proof. Just extract the relevant lines of the IVT proof above. □ 



5.1 Closed bounded intervals map onto closed bounded inter- 
vals 

We can reformulate the theorems of sections 4 and 5 as the following very useful 
theorem. 

Theorem 5.5. Let f : [a, b] — > M. be a real valued continuous function. Then f ([a, b]) = 
[to, M] for some m,M eR. 

That is, a continuous real-valued function maps a closed and bounded interval onto a 
closed and bounded interval. 

Proof. Let m := mf x€ ^ a ^ f\x) and M := sup^^ f(x). These exist by the theorem 
on boundedness. Clearly / ([a, b]) C [m, M]. 

By the theorem on the attainment of bounds, there exist £ G [a, b] and rj G [a, b] such 
that /(£) = to and f(r}) = M; hence to, M G / ([a, 6]). 

Now let y G [to, M], so /(£) < y < f(rj). By applying the IVT to / restricted to the 
interval [£, rj\ (or [77, £] as case may be) we find an x G [£, 77] C [a, 6] such that f(x) = y; 
hence y G f ([a,b]). Hence [to, M] C / ([a, 6]). □ 

5 That is [x n+ \,y n+ i] C [a;„,j/ n ] for each n 
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6 Monotone Functions and the Continuous Inverse 
Function Theorem 

6.1 Monotone Functions 

The following definitions require the ordered structure of real numbers, and so apply 
only in KL 

Definition 6.1. Let E C R and f : E R. We say that: 

(a) (i) f is increasing if f(x) ^ f(y) whenever x ^ y. 

(ii) f is strictly increasing if f\x) < f(y) whenever x < y. 

(b) (i) f is decreasing if f(x) ^ f\y) whenever x ^ y. 

(ii) f is strictly decreasing if f(x) > f(y) whenever x < y. 

A function is called monotone on E if it is increasing or decreasing on E. 

6.2 Continuity of the Inverse Function 

Recall that the inverse function was defined in 'Introduction to Pure Mathematics' 
last term. 

Definition 6.2. Let f : A — > B be a function. We say that e f is invertible' if there 
exists a function g : B — >■ A such that g(f(x)) = x for all x e A and f(g{y)) = y, for 
all y G B. We then call g an inverse of f. 

We have seen that continuous functions map intervals to intervals. We want to say 
something about the inverse function when it exists. Note that any result about 
increasing functions / can be translated into a result about decreasing functions simply 
by considering the functions — /. 

We will prove: 

Theorem 6.1 (Continuous Inverse Function Theorem (IFT)). Let f be a strictly 
increasing and continuous real valued function on [a, b] . Then f has a well-defined 
continuous inverse on [/(a), /(&)]. 

This is contained in the following theorem. 

Theorem 6.2. Let f : [a, b] — > R be strictly increasing and continuous on [a,b]. Then 
(i) f([a,b]) = [f(a),f(b)]; 
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(ii) / has a unique inverse g : [/(a), /(&)] — > R; 

(iii) 5 strictly increasing; 

(iv) c/ zs continuous. 

Proof, (i) This is just Theorem 5.5 as in this case m = f(a) and M = f(b). 

(ii) This is straightforward; / : [a, b] — > [f(a),f(b)] is now 1 — 1 and onto. So given 
y G [f(a),f(b)] there exists a unique x € [a, b] such that /(#) = y. Define g(y) = x. 
So the inverse function exists and is unique. 

(iii) This is also straightforward. Assume there exist u,v G [/(a), /(&)] with u < i> but 
g(u) ^ <7(f)- But as / is strictly increasing this implies u = f(g(u)) ^ f{g{v)) = v , a 
contradiction. 

(iv) We wish to prove that for any yo G [/(a), /(&)] the function g is continuous at yo- 
For y G (/(a), /(&)): Given e > 0, if necessary take e smaller such that g(yo) + e G [a, 6] 
and g>(y ) - e G [a, 6]. 

Choose 5 = min{/(5r(y ) + e) - y ,y - f(g(yo) ~ e)}. (Draw the graph of #(y) to see 
why we choose it like this) Then 

y -5 <y <y + 5 
=^ f(g(yo) - e) < y < /(s(y ) + e) 

g(f(g(yo)-e)) < g(y) < g(f(g(yo) + e)) 

=>• 0(j/o) - e < #(y) < </(y ) + e 

and g is continuous at yo as required. The points yo = f(a) and yo = f(b) are similar. 

[For example, if yo = f(a): Given e > 0, if necessary take e smaller such that a + e < b. 
Choose 5 = f(a + e) - f{a). Then y G [f(a),f(b)] with \y - f(a)\ < 5 

f(a)<y<f(a) + 5 
=>• f(a) <y < f(a + e) 

=>• a < 5"(y) < a + e 

and, as g(f(a)) = a, g is continuous at /(a) as required. ] □ 

Remark 6.3. iVote t/iat /rom problem sheet 3, if f : [a, 6] — >■ ffi. is a continuous, 
1-1 function with /(a) < /(&), i/ien / is strictly increasing on [a, b\. So for the Inverse 
Function Theorem (IFT) it is sufficient to assume that f : [a, b] — > M. is continuous 
and 1-1. 

Note 6.4. If you choose to use the notation f~ x for the inverse function then you 
must make very clear what you intend the domains of f and f^ 1 to be. For example 
sine and cosine are only invertible on a part of their domain where they are increasing 
or decreasing. 



28 



6.3 Exponentials, Logarithms, Powers etc. 

In the following I will consider the functions only on real domains. Some of the results 
extend to complex domains. 

Recall from Analysis I that functions such as exp(rc), sin(x), cos(x), sinh(a;) and cosh(:r) 
etc are defined by their power series each of which has infinite radius of convergence. 
Later we will see that a power series is continuous within its radius of convergence so 
each of these functions is continuous on R. For each of them, if we take as domain a 
closed interval on which the function is strictly monotone, then we can use the IFT to 
show the function, with the given domain, has a continuous inverse. (See also Problem 
sheet 3 Q5) 

In particular we can therefore define the exponential function: exp : 1 -> 1 as 
exp(x) = Yl ^r- Most of the following properties were proved in Analysis I (though 
some used results to be proved in this course): 

1. exp'(x) = exp(rc); 

2. exp(x) exp(y) = exp (a; + y); 

3. expO = 1 and exp(— x) = 1/ exp(x); 

4. exp(x) > 0; 

5. As noted above exp is continuous. But we can also prove it directly 
Lemma 6.5. The function exp is continuous. 

Proof. We have 



so for \h\ < 1 we have by the Triangle Law and the preservation of ^ under 



exp(x + h) — exp(x)| = exp(x)| exp(h) — 1)| 



limits 



exp(x + h) — exp(a;)| ^ exp(x) \h\ n /n\ ^ exp(:r) >^ \h\ 



n 



\h\ 



exp(x), 



1 - \h 




which tends to as h — >• 0. 



□ 
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We can obtain numerous inequalities: For example if x > 0, 




r=3 



and hence also if x > 0, 



exp(— x) < 



1 



1 + x 
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Remark 6.6. Recall that in the limit strict inequalities become weak, so we have 
used the term |y to ensure strict inequality. This useful trick was also used in 
Analysis I and we will use it in future without comment. 

7. The logarithm: 

Lemma 6.7. exp is strictly increasing and exp : R — > (0, oo) is a bijection and 
hence invertible. The inverse is denoted by log : (0, oo) — > R. Furthermore, for 
every y > the function log is continuous at y. 

Proof. We will prove later that exp is strictly increasing and hence 1-1 in Propo- 
sition 13.3 (using the fact that expire) > Vx G 1). 

Now we prove that exp(x) maps R onto (0, oo). Given y > we can find A such 
that 1/(1 + A) < y < 1 + A Hence exp(-A) < 1/(1 + A) < y < 1 + A < exp(A). 
Thus by the IVT there exists x G (—A, A) such that exp(x) = y, as required. 

Finally we can apply the IFT to exp : [—A, A] — > [exp(— A), exp(A)]. The image 
interval then contains y so log is continuous at y. □ 

Remark 6.8. When dealing with inverses of functions on unbounded intervals 
one generally proceeds in this way. First prove the function is a bijection - 
generally using the IVT- then show the inverse is continuous at a general point 
y by applying the IFT to a suitable closed bounded interval. 

8. Let e denote the real number e = exp(l) = h. ^ nen ^°S e = ^ 

9. For any a > and any iGiwe define 

a x := exp(xloga). 
Then a x+y = a x a y ; Also e x = exp(x); 

Note: We can also define exp : C — > C by exp(z) = Yl ^r- The first 3 of the above 
properties also hold in C and also exp(z) ^ 0. 

6.4 Left-hand and Right-hand limits 

For functions defined on an interval, we may talk about right-hand and left-hand limits. 

Definition 6.3. (i) Let f : [a, b) R (or C) and p e [a, b); and let I G R (or I G C). 
We say that I is the right-hand limit of f at p if, Vt > ; 35 > such that 
G [a, b) such that < x — p < 5 

\f(x)-l\<e. 
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We write this as 

lim f(x) = I] or as lim/(x); or sometimes as f(p+) = I- 

X—>-p+ X-— 5>p 

x>p 

Similarly we have: 

(ii) Let f : (a, b] — > R (or C) and p G (a, b\; and let I e R (or I E C). We say that I 
is the left-hand limit of f at p if, > 0, 35 > snc/i £/iat Vrr e [a, 6) suc/i t/iat 
-5 < a -p < 

|/(x)-Z|<e. 

We wnie t/ws as 

lim f(x) = I] or as lim f(x); or sometimes as f(p—) = I- 

X^rp— x^p 

x<p 

The following provides good practice in using the definitions. 

Proposition 6.9. Let f : (a, b) — > C and let p e (a, 6). TTien £/ie following are 
equivalent: 

(i) lim^p/tV) = /; 

(ii) Both lim x _^ p+ f(x) = I and lim^^p. f(x) = I. 
Example 6.1. Consider function f : R — >■ R given by 

( ( x ifx^O; 
J W \ ar + l i/x < 0. 

T/ien /(0+) = and /(0— ) = 1. 5ui lim^o /(x) does not exist. 

6.5 Left-continuity and Right-continuity 

We translate the above definitions into 'continuity' language. 

Definition 6.4. (i) We say f is right continuous at p if f(p+) = f(p)- 6 

(ii) We say f is left continuous at p if f(p—) = f(p)- 

Again, for practice prove the following. 

Proposition 6.10. Let f : (a, b) — >■ R and let p e (a, 6). Then the following are 
equivalent: 

(i) / is continuous at p; 



3 Note that we are saying that the limit exists and that it equals f(p). 

31 



(ii) / is both left- continuous at p and right- continuous at p. 

Example 6.2. Again consider the function 

fx ifx^O; 
n ' \ x + 1 ifx<0. 

Then at f is right continuous but not left continuous. It is not continuous at 0. 



6.6 Continuity of Monotone Functions 

This section will be omitted from lectures and is included as an example. 

We now discuss the continuity of monotone functions. Remember that any result about in- 
creasing functions / can be translated into a result about decreasing functions by considering 
instead the functions — /. 

Theorem 6.11. Let f : (a, b) — > R be an increasing function. Then for every xq G (a, b) the 
right-hand limit f(xo+) and the left-hand limit f(xo-) of f at xq exist. 

Moreover, f(x ~) = swp a<x<XQ f(x), f(x +) = mf Xo<x<b f(x) and 

f(xo~) < /(so) < f(x +). 

Proof. By hypothesis, {/(x) : a < x < xq} is non-empty and is bounded above by f(xo), and 
therefore has a least upper bound A : — sup a< ^ a ,<, z . /(^)* Then A ^ /(xo). ^Ve have to show 
that f(xo—) = A. Let e > be given. It follows from the definition of sup a<x<XQ f(x), that 
there is a x £ G (a, xq) such that 

A - e < f(x e ) < A. 

As xq — x £ > choose S := xq — x £ . Then, x £ (x £ , xo) if and only if < xq — x < 5, and 
thus, as / is increasing 

A- e < [f(x £ ) ^ ] f(x) ^ A for all < x - x < 5. 

By definition f(xo—) = A and we are done. 

The other inequality can be obtained by a similar argument (a good exercise); or by applying 
what we have done to the function —f(b — x) on (0, b — a) and juggling with the inequalities. 

□ 

Remark 6.12. Informally we call the difference /(xq+) — f(xo— ) the "jump" of f at xq. 



7 Limits at infinity and infinite limits 

7.1 Limits at infinity: functions of a real variable 

We want to extend our definition of the limit 'lim^a /(x)' to allow us to talk about 
the end points of infinite intervals like (0, oo). 
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Definition 7.1. Let E CK and f : E -> R (or Cj and let I G R ("or C/ Suppose that 
for every b G R t/ie set fl (6, +00) zs non-empty. We say that f(x) —> I asx4 +00 
i/ ; Ve > 0, 3B > such that \/x <E E such that x > B 

\f(x)-l\ < e. 

We write this as lim^+oo f(x) = I. 

Exercise 7.1. Make a similar definition for lim^^oo f(x) — I. 

Note 7.1. We will often just write 'f(x)—tl as x — > 00 ' for e f(x) — >■ I as x — )■ +00 
There is a slight danger of confusion — see what we say about functions of a complex 
variable — but if we take care it will be all right. 

7.2 Limits at infinity: functions of a complex variable 

Definition 7.2. Now let E C C and f : E -> R (or C) and let I e R (orC). Suppose 
that for every b G R there are points z G E such that \z\ > b. We say that f(z) — >■ I 
as z — >■ 00 i/ ; > ; 3B > snc/i t/iat Vz & E such that \z\ > B 

\f(z)-l\<s. 

We write this as lim^oo f(z) = I. 

Note that there may be a mild inconsistency with the previous definition if E C R. If 
we are thinking 'complex' we'll need both the real limits at ±00 to be equal. 

sin z 

Example 7.1. Consider as z — > 00. For real values z = x we get that 

z 

— — > as x — > 00. But for pure imaginary values like z^ = 2nik, with k G Z we'll 
\x\ 

,271-fc _ e -2wk 

: > 00 as k — > 00. 

Auk 

Exercise 7.2. Write down the contrapositive of 'f tends to a limit as z — > 00. 

7.3 Tending to infinity. . . 

Very briefly we discuss 'infinite limits'. We must take great care not to deceive our- 
selves: in neither R nor C is there a number 00. 

Definition 7.3. Let E C R (or C) and f : E — > R and let p be a limit point of E. 
We say that f(z) tends to +00 as z — >■ p if\/B > 0, 35 > such that Vz G E such 
that < \z — p\ < 5 

f(z) > B. 

We may write this as f(z) — > +00 as z — >■ p. 



get that 



sin Zk 
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Exercise 7.3. Make a similar definition for f(z) — > — oo as z — >■ p. 
For complex valued functions things are easier: 

Definition 7.4. Let E C WL (or C) and f : E — > C and /e£ p be a limit point of E. 
We say that f(z) tends to oo as z p if MB > 35 > sncn iaai \/z E E such 
that < \z — p\ < 5 

\m\>B. 

We may write this as f(z) — > oo as z — )• p. 

7.4 Euler's Limit 

We prove the following result. 

Proposition 7.2. The limits lim^oo (l + and linx E _ 5> _ 00 (l + ^ x exist and are 
both equal to e. 

There are a number of ways of proving these. One method uses integration and looks 
at the area under the curve 1/x. Another uses L'Hopital's rule and will be given in 
Section 14. The following is a direct proof. 

Proof. First limit: Recall that (l + ^ x := exp (a; log (l + |)). By the continuity of 
exp, from Problem Sheet 4,Q4b it is enough to prove that lim^oo x log (l + |) = 1, 
or by AOL that lirn^oo xlog ^ 1+ i^ = 1- Write y = log (l + |); then 

1 x = exp(y) - l- y 

x\og{\ + \) y 

Note that as 1 + \ > 1 for x > 0, we have y > 0, and then 

Q < exp(y) -1-1/ = En>2 ^"/ n! < En>2 1/" = 1/ 

y y y i-y' 

So if we can show that y — > as x — > oo we are done. But as log is continuous at 1 
we can again use Problem Sheet 4,Q4b to see immediately that y = log(l + |) — > as 
x -)■ oo as required. 

A similar argument will deal with the other limit. 

□ 
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8 Uniform Convergence 



8.1 Motivation 

Let £CR(orC), and let p G E be a limit point, so that p = \im x _> p x. We have seen 
that 'continuity at p' is exactly the right condition to ensure that 

\imf(x) = /(lima;), 

x— >p x— >p 

that is to ensure that 'taking the limit lim x _» p ' and 'finding the value under /' can be 
interchanged. 

There are many other situations in which we would like to understand whether the 
order in which we perform two mathematical operations is significant or not: 

(i) Suppose we have not just a single function / on E but a whole sequence (/„). 

When is lim^oo lim x _^ p f n (x) = lim x _» p lim^oo f n {x)l 

In particular, if f n (x) is continuous at p, when is lim^oo f n (x) continuous at pi 

(ii) Similarly, when is lirn^p f n (x) = Ylo" hm^p f n (x) and in particular if f n (x) 

is continuous at p when is f n {x) continuous at pi 

(iii) Once we have defined derivatives and integrals — as limits — we will want to know 

when lim^oo f n (x) = (lim n _>oo f n {x))'l and when Yim^^ f n (t) dt = J* lim^oo f n (t) dtl 
So when can we differentiate a series term by term and when can we integrate it 
term by term? 

The answers to some of these questions are given in this lecture and the next. 

To see that there are non-trivial problems we look at one typical example. 

Example 8.1. Consider the sequence of functions (/„), where f n : [0, 1] — > R given by 

—nx + 1 if ^ x < - , 

ifx^±. 



fn(x) 



Consider also the function f : [0, 1] — >■ K. given by 

f i \ _ / 1 ifx — 0, 

nx) ~\0 ifx>0. 

Sketch their graphs, and note that for all x G [0, 1] we have that f{x) = lim^oo f n (x). 

Note that although all the f n are continuous the limit function f is not continuous at 
0. 

[Once we have Theorem 8.2 we will be able to prove that f n is not uniformly con- 
vergent to f on [0,1]. Hint: Consider x n = l/(2n). Then f n (x n ) = 1/2 so that 
supj.^0,1] \fn( x ) — f( x )\ > fn( x n) = 1/2 0. Alternatively once we have Theorem 9.1 
we can say immediately that the convergence is not uniform as we have a sequence of 
continuous functions whose limit is not continuous. 
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8.2 Definition 



As the sum of an infinite series is defined as the limit of the sequence of partial sums 
we will start by looking at sequences of functions. 

Let E C K. (or C) and let f n : E — >■ R (or C) be a sequence of functions. Then for each 
(fixed) x G E, (f n (x)) is a sequence of real (or complex) numbers. If this sequence 
converges for every x G E, then the limit which will depend on x so we will call it f(x). 
Thus / : E — > ffi. (or C) is a function. Hence we have the definition (using Analysis I): 

Definition 8.1. By f n converges to f on E we mean that Vrr G E, and Ve > 0, 

3N G N such that Vn > N 



So, of course, in general N depends on x. 

Just as when we defined 'uniform continuity' as a stronger version of 'continuous at 
all points' by insisting on being able to choose one '<5' to deal with all points, so we 
now strengthen our definition of 'convergence of a sequence of functions'. For 'uniform 
convergence' we insist that one N works for all x. 

Definition 8.2. By f n converges uniformly to f on E we mean that Ve > ; 
3N G N such that Vn > N and Vr G E 



We write this as e f n — > f uniformly on E' or e f n —>■/'. 
It is trivial to see that: 

Proposition 8.1. If the sequence (f n ) converges uniformly to f on E then at every 
point x G E we have that the sequence (/„(#)) converges to f(x). 

There is one special case which we should single out. Suppose that for each n G N we 
have that s n (x) = Ylo fk(%) an d that s : E — > R (or C). If we apply the definition to 
the sequence (s n ) and the function s we will get 

Definition 8.3. We say that the series fn converges uniformly to s on E if 

> 0, 3N G N such that Vn > N and G E 



\f n (x)-f(x)\ < e. 



\f n (x)-f(x)\ < e. 




We may write this as 'Y^o fn(x) = s(x) (uniformly on E)\ 
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8.3 Test for Uniform Convergence 

We can re-express the definition in a more practical way: 

Theorem 8.2. Let E be a non-empty subset o/R or C. Let f n ,f : E — > R (or C). 
Then the following are equivalent: 

(i) /„->■/ uniformly on E; 

(ii) 3N s.t. Vn > iV ; m n := sup^g^ \f n (x) — f(x)\ exists and m n — > as n — > oo. 
Proof. (=*►) 

Suppose f n -> f uniformly on E 1 . That is > 0, 3iV G N such that \/x e E and 
Vn>iV ' 

|/n(a;) - /(a:)| < |e. 

Hence, for each n > N, \e is an upper bound of the set {\f n (x) — f(x)\ : x G E}. So 
m n exists and 

m n = sup \ f n (x) - f(x)\ ^ |e < e Vn > iV. 

x€E 

By the definition of sequence limits, lim^oo m n = 0. 
(<=) 

Suppose the m n exist for all n > Ni, and that lim^oo sup^g^ \f n (x) — f(x)\ = 0, Then 
Ve > 3N > Ni such that Vn > N 

sup \f n (x) - f(x)\ < e. 

x£E 

Therefore 

\fn(x) - f(x)\ ^ sup \f n (x) - f(x)\ <e \/x <E E and Mn > N. 
That is f n — > f uniformly on E. □ 

Example 8.2. Let E = [0,1) and let f n (x) = x n . Clearly lim n _^oo f n (x) = 0, so 
f(x) = 0. Then m n = svp xeE \x n — 0| = sup xeE x n . But x n = (1/2)™ G E and 
fn{x n ) = 1/2 so that 

m n ^ / n (x n ) = 1/2^0, as n^- oo 
so f n is not uniformly convergent on [0, 1). 

However, if instead we consider E = [0,r], where < r < 1 is a fixed constant. Then 
x n — > uniformly on E, because now 

m n = supx n ^ r n — > 0, as n — >■ oo. 

[0,r] 
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Remark 8.3. The test is particularly useful if E = [a, b] and the functions f n and f 
are differentiable. In such cases the supremum will be achieved either at a or at b or 

at some interior point where — \ — — — = 0. We will prove this later in the 

ax 

course; for the moment you can use it in exercises. 7 



7 0f course we will not use it in building up the theory. 
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8.4 Cauchy's Criterion 



Just as we found for sequences of numbers there is a characterisation of uniform con- 
vergence which does not depend on knowing the limit function. 

Theorem 8.4 (Cauchy's Criterion for Uniform Convergence). Let E C K. (or 

C) and let f n : E — » R (or C). Then f n converges uniformly on E, if and only if, 
Vs > 0, 3N G N such that Vn,m> N and Vrr G E 

\fn(x) ~ f m (x)\ < E. (*) 



Proof. (=>•) Suppose /„ converges uniformly on E with limit function /, then Ve > 0, 
3iV G N such that Mn> N and Vx e E 

\f n {x)-f{x)\<\e. 

So, Vx <E E and Vn, m > N 

\fn(x)-f m (x)\ ^ \f n (x)-f(x)\ + \f m (x)-f(x)\ 

< ¥+¥ 

= e. 



(<=) Conversely, suppose (*) holds. Then for any x G E, (f n (x)) is a Cauchy 
sequence, so that it is convergent. Let us denote its limit by f(x). For every e > 0, 
choose iV G N such that Vn, m > N and Vrr G E 

\fn(x) - /m(z)| < \e. 

Now fix n > N and x £ E, and let m — >■ oo in the above inequality. So, by the 
preservation of weak inequalities 

\fn{x) ~ f(x)\ = lim \f n (x) - f m (x)\ < \e < E. 
m— >oo 

Hence f n — > f uniformly on E. □ 

Corollary 8.5 (Cauchy's criterion for uniform convergence of series). The series 
Yl^=o fn is uniformly convergent on E if and only if Ve > 0, 3iV G N such that 
Vn > m > N and Vx G E 



E aw 



< £. 



k=m+l 



8.5 The M-test 



As a consequence, we prove the following simple but very important test for uniform 
convergence of series. 
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Theorem 8.6 (The Weierstrass M-Test). Let E C R (or C) and f n : E ->■ R ("or 
Cj. Suppose that there is a sequence (M n ) of real numbers such that 

\f n (x)\^M n WxeE. 

IfY^=oM n converges then Y^=ofn converges uniformly on E. 

Note that the M n must be independent of x. 

Proof. By Cauchy's Criterion for the convergence of we have that Ve > 0, 

3N G N such that Vn > m> N 

n 

M k<e. 

k=m+l 

Now by the Triangle Law 



fc=m+l 



^ E l^ fe W ^ E ^fc < e,Vn > m > N and Vrr G -E 1 , 

fc=m+l fc=m+l 



which is Cauchy's criterion for the uniform convergence of the series. 



□ 



Corollary 8.7. Suppose the conditions for the M-test hold, and ^ M n is convergent. 
Then 



£/»(*) 



?1=0 



^ E \f»( X )\ ^E M " V;rGE - 



n=0 



n=0 



Proof. Apply the preservation of weak inequalities as iV — > oo to the obvious inequal- 
ities 



N 



n=0 



X 



N 



N 



71=0 



n=0 



□ 



9 Uniform Convergence: Examples and Applica- 
tions 



9.1 Examples 

Example 9.1. Let E = [0, 1] and let 

nx 

fn(x) = 



1 + n 2 x 2 

Then clearly lim^oo f n (x) = for every x G [0, 1]. 
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But f n {l /n) = 1/2, so that 



sup \f n (x) - f(x)\ ^ - ^ as n ^ oo 



xe[o,i] 



and so f n converges to but not uniformly in [0, 1]. 
Example 9.2. X^o 2 -™ converges to in (—1,1), but not uniformly. 



From Analysis I, s n (x) = J2k=o 



x 



-x 
l-x n+1 



*™ tends to f or an V \x\<l. On the other 



hand 



so that (look at x = 

sup s n (x) 
xe(-i,i) 



( 



X 



X 



n+1 



1 — X\ 



X 



n+i \n+l 
n+2J 



n + 2 



—7" oo. 



l-i _ n+l| /-, , 1 \ n+1 

Hence Y^=q xU doesn't converge uniformly. 

Example 9.3. Y^=o xn converges uniformly on [— r, r] for any < r < I. 
This follows from the M-test with M n := r n . 



9.2 Uniform Convergence preserves continuity 

We have already seen that the limit of a sequence of continuous functions may not be 
continuous. This very important theorem tells us that 'uniformity' gives us the extra 
condition we need. 

Theorem 9.1. Let f n ,f : E — > K. (or C), and /„—>■/ uniformly in E. Suppose all f n 
are continuous at xq G E. Then the limit function f is also continuous at xq, so that 

lim lim f n (x) = lim f n (x ) = lim lim f n (x). 

x^tXQ n— ¥oo n— s-oo n— >oo x— >xo 

Proof. Ve > 3N G N s.t. Vn > iV and Vrr G E 

\f n (x) - f(x)\ < Is. 

Since /at+i is continuous at xo, 35 > (depending on x and e) such that \/x G E such 
that | a; — x \ < 5 

\f N +i(x) - f N+1 (x )\ < \e. 
Hence, if x G E and \x — x \ < 5, then by the Triangle Law 

l/(*)-/(*o)| 

< \f( x ) ~ fN+i(x) \ + |/jv+i(a;) - f N +i( x o)\ + |/jv+i(^o) - f(x )\ 
= e. 



By definition, / is continuous at xq. 



□ 
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Note it is very important that N + 1 is fixed, so that 5 does not depend on n. 



Remark 9.2 (Version for series). IfY^=of n conver 9 es uniformly on E and every f n 
is continuous at x e E, then the function Y^=o fn( x ) ^ s continuous at x , that is 



lim V f n (x) = Y] f n (x ). 



n=0 n=0 



In particular, if f n is continuous on E for all n and Y^=o fn converges uniformly on 
E, then Y^=ofn ^ s continuous on E. 



9.3 Power Series 

We can apply the the results of the previous subsection to the important case of power 
series. 

Theorem 9.3 (Continuity of Power Series). Suppose the radius of convergence of 
the power series J2™ =0 a n x n is R, where ^ R ^ oo. Then for every ^ r < R, 
Yl^=o a nX n converges uniformly on the closed disk {x : \x\ ^ r}. Therefore, Y^=o a nX n 
is continuous on the open disk {x : \x\ < R}. 

Proof. By the definition of 'radius of convergence', J2™= -n Q"fi,*£ IS absolutely convergent 
for \x\ < R. In particular, Xl^Lo l a nl r ™ * s convergent. Since 

|an^ ra | ^ |a„|r n for all x such that \x\ ^ r 

we have, by Weierstrass M-test with M n = \a n \r n , that Y^=o a n,x n converges uniformly 
on {x : \x\ ^ r}. 

But GjyiX IS continuous for any nGN. So, for any r < R, Yl^=o a n% n is continuous for 
\x\ ^ r, and hence on the open disk {x : \x\ < R}. □ 

Example 9.4. Note that in general it is not true that the power series is uniformly 
convergent on \x\ < R. For example if a power series Yl^=o a n xn i s uniformly conver- 
gent on M., then there exists iVeN such that a n = for all n > N. 

Proof: By CC for uniform convergence Ve > ; 3N e N such that for all n > m > N 
and Vi G R, | J2r=m+i a rX r \ < e. So in particular for all r > N + 1 and all x e R 

\a r x r \ < e. 

Hence a r = for all r > N + 1 . 

Note 9.4. Note that Theorem 9.3 says nothing about convergence or continuity at the 
end-points. If you are interested, subsection 9.5 deals with this in the real case. 

Corollary 9.5. The functions exprr, sinrr, cosrr, cosh a; and sinhx can all be defined 
by power series with infinite radius of convergence so are all continuous on C. 
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9.4 Integrals and derivatives of sequences 

Next term, in the course Analysis III, you will learn how to define integrals, and the 
proofs of the following theorems will be given. 

Theorem 9.6. If f n — >■ / uniformly on [a,b] and if every f n is continuous, then 

b rb pb 

f = lim /„ = lim / /„. 

Similarly, if the series X^Li fn converges uniformly on [a, b] and if all f n are contin- 
uous, then we may integrate the series term by term 

ft OO OO „ft 

£ f n = £ / f n ~ 

a n =l n=l Ja 

Note 9.7. However, uniform convergence is not the 'right' condition for integrating 
a series term by term: we can exchange the order of integration J (which involves a 
limiting procedure) and lim^oo under much weaker conditions. The search for correct 
conditions for term-by-term integration led to the discovery of Lebesgue integration 
[Part A option: Integration] . 

Theorem 9.8. Let f n (x) — > f(x) for each x G [a, b]. Suppose f' n exists and is contin- 
uous on [a, b] for every n, and that f^—>g uniformly on [a, b] . Then f exists and is 
continuous on [a,b], and\/x G [a, 6] 

lim f n (x) = lim -^-f n (x). 

(XX n->oo n^oo dX 

Similarly, if J2^=o fn converges on [a,b], and if every f' n exists and is continuous on 
[a,b] and if Yln°=o f'n converges uniformly on [a,b], then J2n°=o fn ^ s differentiate on 
[a,b], its derivative is continuous, andWx G [a, b] 

j oo oo 

-^£/»(*) = ££(*)■ 

n=0 n=01 



9.5 The end points 

This section will be omitted from lectures and is included for interest. 

When < R < oo the points where \z\ = R need to be handled differently. We only deal 
with the real case, so there are two such points R and —R. Scaling (replacing x by x/R or 
—x/R) lets us deal only with power series where the radius is 1 and describe what happens 
at x = 1. 
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Theorem 9.9 (Abel's Continuity Theorem). Suppose that the series ^2^ = Qa n x n has 
radius of convergence R = \. Suppose further that J2n°=o a n converges. 

Then Yl^=o a nX n converges uniformly on [0, 1] . 

Consequently, Y^=o a nX n is continuous on (—1,1], and in particular 



n=0 



n=0 



Proof. First note that our general result gives continuity on (—1, 1); it is only the point x = 1 
we have to deal with. We will get continuity provided we get uniform convergence on [0, 1]. 

By Cauchy's Criterion for the convergent Yl^=o a n we have that, for every e > 0, there is N 
such that, for every n > m > N we have 



n 
k=m 



< e. 



Now fix m > iV, and for the partial sums from m use the notation 

k 

A k = a 3 f° r k ^ m; and A m -\ = 

j=m 

noting that subtracting consecutive sums gives us back the original sequence 8 

ak = A k - A k -i. 

By what we have from the Cauchy Criterion above, \A k \ < e whenever k ^ m — 1. We have 
by elementary algebra the following formula 9 



E 

k=m 



a k x 



k=m 

Hence, by the Triangle Law we have that 

n— 1 



Y,( A k -M-l)x k 

n n 

A k x k - Y A k -ix k 

k=m k=m 
n-l 

^2 A t (i*-i l+1 ) +A n x". 



E 

k=m 



a k x 



Y\A k \(x k -x k+l ) + \A n \x n 

k=m 
n-l 

< e^[x k - + ex n 



= ex 
^ e 



k=m 
m 



3 Think 'Differentiation undoes Integration'. 

3 This is called Abel's summation formula — think 'integration by parts'. 
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for any x G [0, 1]. 

The Cauchy Criterion yields that Y^=o a nX n is uniformly convergent on [0, 1]. □ 

9.6 Monotone Sequences of Continuous Functions 

This section will be omitted from lectures and is included for interest. 

The theorem of this subsection is a partial converse of our theorem that 'uniform convergence 
preserves continuity'; if the sequence is monotone then the continuity of the limit will give 
uniformity of convergence. 

Theorem 9.10 (The Dini Theorem). . Let f n be a sequence of real continuous functions 
on [a, b]; and let f be a real continuous function on [a, b\. 

Suppose that 

lim f n (x) = f(x) for every x G [a, b] 

n— >co 

and that 

fn{x) ^ f n +i(x) for all n and for all x G [a, b\. 
Then f n — >■ / uniformly on [a, b] . 

Proof. Let g n (x) = f n (x)-f(x). Then g n is continuous for every n, g n ^ and lim^oo g n (x) = 
for any x G [a,b]. Suppose (g n ) were not uniformly convergent on [a, b]. Write down the 
contrapositive to see that for some e > 0, and every natural number k there exists a natural 
number > k and a point x^ G [a, b] such that 

\9n k (Xk)\ = 9n k {Xk) > e. 

We may choose n& so that k — > is increasing. We may assume that Xk — > p — otherwise 
use the Bolzano-Weierstrass theorem to extract a convergent subsequence of (xk) and use it 
instead. Then p G [a, b]. For any (fixed) k, since (g n ) is decreasing, 

e < 9ni{xi) ^ g nk (xi) 

for all I > k. Letting I — > oo in the above inequality, we obtain 

£ ^ lim g nk {xi) = g nk (p) 

l— >oo 

as g nk is continuous at p. This contradicts to the assumption that lim^oo g nk (p) = 0. □ 

Example 9.5. Let f n (x) = j-^ for x G (0, 1). Then lim^oo f n (x) = for every x G (0, 1) ; 
f n is decreasing in n, but f n does not converge uniformly. Dini's theorem doesn't apply, as 
(0, 1) is not compact. 
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10 Differentiation: definitions and elementary re- 
sults 



10.1 Definitions 



In this course we only study differentiability for real (or complex)-valued functions 
on E, where E is a subset of the real line KL The theory of the differentiability of 
complex valued functions on the complex plane C is very different from the real case 
and requires another theory — See Complex Analysis [Part A: Analysis]. Generally E 
will be an interval. 

Definition 10.1. Let f : (a, b) — > M (or C), and let x e (a, b). By f is differen- 

tiable at x we mean that the following limit exists: 

> im /(*>-/(*->, 

x-*xo X — Xq 

When it exists we denote the limit by f\xo) which we call the derivative of f at Xq. 



[That is Ve > 35 > such that Vrr e (a, b) such that < \x - x \ < 5 

f(x) - f(x ) 



X — Xq 



- /'(so) 



<e.} 



For example, it is easy to see that the function f(x) = x is differentiable at every 
point of K. and has derivative f'(x ) = 1 at every point; and the function g(t) = e 2mt 
is differentiable at every point, although we can't yet prove that. 

Sometimes it is helpful to also define 'left-hand' and 'right-hand' versions of these. 

Definition 10.2. (i) Let f : [a, b) — > R (orC), and let x G E [a, b). We say that f has 
a right- derivative at x if the following limit exists 

lim f(x)-f(x ) ^ 

x^x + X — Xq 

If the limit exists we denote it by f' + (xo). 

(ii) Let f : (a, b] — > M. (orC), and let x G (a, b]. We say that f has a left- derivative 
at xq if the following limit exists 

x-^xo- X — Xq 

If the limit exists we denote it by f'_(xo). 



The following result is easily proved (compare what we did for left- and right-continuity). 
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Proposition 10.1. Let f : (a, b) — > R (or C). Then the following are equivalent: 



(a) f is differentiable at Xq and f'{xo) = I; 

(b) f has both left- and right-derivatives at x , and fL(x ) = I = f' + (xo). 

Definition 10.3. (i) Suppose that f : (a, b) — > R (or C). Then we say that f is 
differentiable on (a,b) if f is differentiable at every point of(a,b). 

(ii) Suppose that f : [a,b] — > R (or C). Then we say that f is differentiable on 

[a,b] if f is differentiable at every point of (a,b), and if f' + (a) and f'_(b) exist. 

If you wish you can define differentiable on (a, b] and [a, b) as well. 

Remark 10.2. Let y = f(x). There are other notations for derivatives 

fx or l G - W - Leibnitz] 

y' or f'(x ) [J. L. Lagrange] 

Dy or Df(x ) [A. L. Cauchy, in particular for vector-valued functions of several 
variables]. 

10.2 An Example 

Define a function / : R — > R by 



/(*) 

Then we can show that 

m = 



x 2 sin - for x > 0, 

x 

for x < 0. 



when x < 0, 

when x = 0, 

2x sin cos — when x > 0. 

X X 



The derivative for x ^ can be found directly from the definition. Later we will see 
that we can use the chain rule to find the derivative for x > 0. 

Note that the derivative is not continuous at the origin. (See problem sheet 5.) 

1 1 

We can get other interesting examples by replacing the l x 2 by x a and the ' — ' by — . 

x xp 
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10.3 Derivatives and differentials 



By looking at the definition of 'limit' in terms of e and 5 (see problem sheet) we can 
easily prove that: 

Proposition 10.3. Suppose that f : (a, b) — > R is differentiable at x G (a, b) and that 
f'(x ) > 0. Then there exists a 5 > such that for all x G (x ,Xo + 5) we have that 
f(x) > f(xo), and for all x G (x — 5,x ) we have that f(x) < f(x ). 

We have corollaries like: 

Corollary 10.4. Suppose that f : [a, b) — > R is right- differentiable at xq G [a, b) and 
that f' + (xo) > 0. Then there exists a 5 > such that for all x G (x ,x + 5) we have 
that f (x) > f{x ). 

In fact, if / is differentiable at x Q , then the 'increment' of / near x can be expressed 

f(x) - f(x ) = f'(x ) (x - x ) + o(x - x ) 
where o is a function of x and x satisfying 

lim ° {X ~ Xo) = 0. 

x^x X — Xq 

That is, the 'linear part' of the increment f(x) — f(xo) is f'{xo) (x — xq); all the rest 
is small in comparison. This is sometimes called the differential of / at xq. It is the 
first approximation to / near Xq. 



10.4 Differentiability and Continuity 

Theorem 10.5 (Differentiability =^ Continuity). Let f : (a,b) ->■ R (orC). If 
f is differentiable at x G (a, b) then f is continuous at x$. 

Proof. Since 

lim (f(x) - f(x )) = lim li^l ( x _ Xo ) 

x^x x^x x — Xq 

= lim - f ^ lim (x - XQ ) by AOL 

x^>x X — Xq x->x 

= /'Wxo 

= 0. 

Therefore lim^^^,, /(x) = f(x ), so that, by definition, / is continuous at Xq. □ 

Note: The converse is not true. For example \x\ is continuous but is not differentiable at 
0. In fact there exist functions which are continuous everywhere, but not differentiable 
at any point! (See Bartle and Sherbert.) 
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10.5 Algebraic properties 

The following results are straightforward consequences of the Algebra of Limits. They 
let us build up at once all the calculus we learned at school — once we can differentiate 
a few standard functions (constants, linear functions, exp, sin and cos). 

Theorem 10.6. Suppose f,g : (a, b) — > R (or C) are both differentiable at x G (a, b), 
and A,/j6t (or C). 

(i) [Linearity of differentiation] A •/ + //• g is differentiable at x and 

(A -f + fi- g)' (x ) = A • f'(x ) + 11 ■ g'(x ). 

(ii) [The Product Rule] fg:x\-^ f(x)g(x) is differentiable at x and 

(fg)' (xo) = f(xo)g'(x ) + f'(x )g(x ). 
(Hi) [The Quotient Rule] Suppose g(x ) ^ 0. Then x i-> is differentiable at xo and 

f\ ^ _ f'(x )g(x ) - f(x )g'(x ) 



.gj ' ('•'(,) 
Proo/. (ii) Apply AOL to 

f{x)g(x) - f(x )g(x ) = j^ 9i x ) ~ 9M + f{x) - f{x ) 

X — Xq X — Xq X — Xq 

Let x — > x and use the definitions of f'(x ), g'(x ), and the continuity of f(x) so 
f(x) -> f(x ). 

(iii)See problem sheet 5. 

□ 

So now we know that x n is differentiable at all points, so are polynomials, and also 
rational functions at points where the denominator is non zero. 

10.6 The Chain Rule 

Theorem 10.7 (The Chain Rule). Suppose f : (a, b) — > R, and that g : (c,d) — > R. 
Suppose that f ((a,b)) C (c, d), so that g o f : (a,b) — >■ R is defined. 

Suppose further that f is differentiable at x G (a, b), and that g is differentiable at 
f(xo). 

Then g o / is differentiable at x and 

(gof)'(xo) = g , (f(x ))f f (xo). 
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Proof. Write y = f(xo), and define a function v on (c, d) by 

(g(y) - g(yo) , , n , 
ffiVo) for all y ? y , 
y-yo 
for y = y . 

Note that v(y) — > as y — > yo, so that v is continuous at yo- 
Rearranging the definition of v we see that for all y G (c, d) 

g{y) - g(yo) = (y- yo) (g'(yo) + v(y)) 

In particular 

g(f(x)) - g(f(x )) = (f(x) - f(x )) (g'(y ) + v(f(x))) 

so that 

g(f(x)) - g(f(x )) = g ,( y ^ f( x ) - [M + v (f( x ^ lM ~ fM 

X — Xq X — Xq X — Xq 

Since / is differentiable at xq, f continuous at xq. But v is continuous at yo = f(xo) 
and hence v(f(x)) is continuous at x . Thus v(f(x)) — > as x — > x . Letting x — > x 
we obtain, using AOL 

Um 8 (/w)- fl (/(xo)) = Um 

+ lim v(f(x)) lim - /(Xo) 

x-Mo x— kro X — Xq 

= g'(yo)f(x o ) + 0xf(x o ) 
= f'(x )g'(y ) . 

□ 



10.7 Higher Derivatives 

Suppose that / : (a, b) — > M. (or C) is differentiable at every point of some (x — 5, x +5). 
Then it makes sense to ask if /' is differentiable at x . If it is differentiable then we 
denote its derivative by f"(x ). 

More generally we can define the (n + l)-th derivative /( n+1 ) recursively. 

Definition 10.4. Suppose that f : (a, b) — > H. for snc/i £/ia£ /, /',.-■ ;/ < ™' > e3; 2s£ a ^ 
every point of (a, 6). Suppose that x G (a, b). By f is (n + l)-times differentiable 
at xq we mean that /< n ) is differentiable at x . We write f {n+1 \x ) := f {n) '(x ). 

If f has derivatives of all orders on (a, b) we sometimes say it is infinitely differen- 
tiable. 
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The following is proved by an easy induction using Linearity and the Product Rule. 

Theorem 10.8 (The Leibnitz Formula). Let f,g : (a, b) — > R (or C) be n-times 
differentiable on (a,b). Then x h-> f(x)g(x) is n-times differentiable and 

(fgp {x) = j2( n )f^\x)g^\x). 

3=0 



11 The elementary functions 
11.1 Differentiating power series 

The elementary functions — expx, cosx, sin a;, logx, arctanrr — are defined as power 
series, or are got as inverse functions of real functions defined by power series. 

We start with a lemma: 

Lemma 11.1. The power series Y^=o anXn an( ^ Y^=i na n xn ~ l have the same radius 
of convergence. 

Proof. Let the radii be R and R'; we will show R^ R' and R' ^ R. 

R ^ R'\ First suppose that \x\\ < R'; then 'Y^ = ina n x n ~ l is absolutely convergent 
at x — x±. That is, Yln°=i n \ a n\ \ x i\ n 1 converges. Now note that |a„x"| ^ n|a n ||x"|. 
Hence by the comparison test Yln°=o knlkil" converges. Therefore, by definition of 'ra- 
dius of convergence' we have that R ^ R' . 

R' > R: Now suppose that < R; and choose x 2 so that |xi| < \x 2 \ < R. Then 
J^^Lo |a„||x2| n converges, and so (Analysis I) |a n ||x 2 | n — > as n — > oo. But a conver- 
gent sequence is bounded (Analysis I) so there exists M such that |a ri ||x 2 | n_1 < M for 
all n. Now 

'xi 



n-1 

n-1 



n \a n \\xi f < Mn 



x 2 



n-1 



and as, by the Ratio Test ^ is convergent, we have by the Comparison Test 

that Ylri=i n l°n||^i| n_1 is convergent. By the definition of 'radius of convergence' we 
have that R' ^ R. □ 

Theorem 11.2 (Term-by-term differentiation). The power series f(x) := ^2^L cinX n 
and g(x) := Yln°=i ^n^™ -1 have the same radius of convergence R, and for any x such 
that \x\ < R we have that f is differentiable at x and moreover that f'(x) = g(x). 

Proof, (not examinable and will be omitted from the lectures) 
The first part is done by the lemma. 
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Suppose |x| < R; choose some r such that \x\ < r < R. (For example, r := (\x\ +R)/2 
if R < oo, or r = \x\ + 1 if R = oo.) 

For any point w such that |tu| < r, consider 

/H - f(x) 



g(x) = ) a n [ nx n ~ x 

\ w — x I 

n=l 

oo 

= E 



w — X 

n=l 



oo 

n-1 



n=2 



a n | nx 

w — X 



1 



where we have added the series f(w), f(x) and g(x) term by term, which is justified 
by AOL. Our aim is to show that 

f(w)-f(x) 

^ - g(x) ^ astu^i. 

w — X 

The binomial identity 

7/i n x n 

= x n ~ l + X n - 2 W + ■■■ + xw n ~ 2 + w n ~ l 

w — X 

is easily proved by induction; then we have that for any w ^ x and n ^ 2 

-nx n ~ l = x"" 1 + x n ~ 2 w + ■ ■ ■ + xw n ~ 2 + w 71 ' 1 



w — X 



-x n ~ 1 — x n ~ x — ■ ■ ■ — x n ~ x — x n ~ l 



n-1 



k w k - x"- 1 ) 



= E^" 1 

k=l 
n-1 

= ^2x n - 1 -"(w k -x k ). 



k=l 



Let 



Then 



n-1 



h n (w) = a n J2 xn ~ l ~ k (™* - xk ) for n = 2, 3, 



fe=i 



^(X) = > /in M 

7/1 — nr. ^ — ' 



W — X 

n=2 



All /i n are continuous in R as they are polynomials in w; and /i n (rr) = for all n ^ 2. 
We claim that ^« ( w ) converges uniformly in \w\ ^ r. In fact 



n-1 



\h n (w)\ ^ J^lxr-^d^ + N*) 

fc=l 

^ 2n|a n |r n-] 
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Now ^2,n\a n \r n _1 is convergent, so that Yln°=2 ^« ( w ) converges uniformly in closed 
disk {w : |tu| ^ r} by the Weierstrass M-test. Hence Y^=2 ^« ( w ) * s continuous in the 
disk \w\ ^ r as the uniform limit of continuous functions is continuous. Therefore 

oo oo 

lim h n (w) = h n (x) = 

w—>x < ^ < * 



W^tX ' 

n=2 n=2 



so that 



= , im f/w-/w_ gWI+gM 



W — X w^>x \ W — X 

oo 



= lim y^ h n (w) +g(x) 

n=2 

□ 

Alternative Method of Proof: Alternatively, to prove the second part, we can apply 
Theorem 9.8 (for series). Let f n (x) = a n x n , so that f' n {x) = na n x n ~ x exists and is 
continuous. Further Y^=o a nX n is convergent for \x\ < R and, for any < r < R, 
J2^=i na n x n ~ x is uniformly convergent on [— r, r\. Hence, by Theorem 9.8, for all 
\x\ < r, Yl^=o a nX n is differentiable and 

^ oo oo 

— ^ = ^2 na n x n ~ x . 

n=0 n=l 

It follows that this is true for all \x\ < R. 

11.2 The Exponential Function, Trigonometric Functions, Hy- 
perbolic Functions 

The following result follows immediately 

Proposition 11.3. The functions expo;, sin a;, cosrr, coshx and sinhx can all be 

defined by power series with infinite radius of convergence so are all differentiable on 
R. Further: 



(i) exp'x = exprr. 

(ii) cos' x = — sin x and sin' x = cos x. 
(Hi) cosh'x = sinhx and sinh'x = cosh a;. 



53 



Note 11.4. The other trigonometric and hyperbolic functions are defined in terms of 

Sill Ob 

cos and sin or cosh and sinh. For example tan a; := is defined for those x such 

cos a; 

that cosx 7^ 0. Then by the quotient rule it is differentiable wherever it is defined, and 

cos 2 x + sin 2 x . 9 . 2 -.m 

tan x = . We will soon give an easy proof that cos i + sin x — 1 

COS X 

11.3 Differentiability of the Inverse Function 

Theorem 11.5 (Inverse Function Theorem (IFT)). Let f : [a, b] — > [m, M] be a 

strictly increasing continuous function from [a,b] onto [m,M], with inverse function 
g : [m, M] — > [a, b]. Suppose that f is differentiable at x e (a, b) and that f'(x ) ^ 0. 
Then g is differentiable at f(x ), and 



f'(x ) 

Proof. We have already proved that g is continuous. Write y = f(x ). Then for 

y ^ yo 

g(y) - g(yo) x-x = 1 
y-y ' " f(x)-f(x ) ~ zm^Oeo) 

X — XQ 

where x = g(y), and so y = f(x). 

Since g is continuous, x = g(y) — > g(yo) = x$ as y — > yo. Hence 

f_M - fM 

x — x 

As f'(x ) t^O we use AOL to see that 



->■ f'(x Q ) as y ->■ y . 



lim 9 ^ ~ 9 ^ 



y^yo y -y f'(x ) 
exists. That is, g is differentiable at yo, and 

f 1 



g'(yo) = 77 



□ 



11.4 Logarithms 

We continue to deal only with the real case where, in section 6, we defined log : 
(0, oo) — >• M as the inverse function of the real exponential function. 

10 The Pythagoras Theorem. 
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To see that log is differentiable at any y > proceed as we did when we discussed 
continuity, by finding an A such that exp(— A) < y < exp(A) and then using the Inverse 
Function Theorem on the differentiable function exp : [—A, A] — > [exp(— A), exp(A)]. 
We will find that 

log y = = = — 

exp' (logy) exp (logy) y 

as we expect. 
11.5 Powers 

For any x > and any a G K. in section 6 we defined x a = exp(o; logx). From the 
Chain Rule and the properties of exponentials and logarithms we therefore have that 

dx 

12 Rolle's Theorem and the Mean Value Theorem 

12.1 Local maxima and minima 
Definition 12.1. Let E C R and f : E R. 

(i) Xq G E is a local maximum if for some 5 > 0, f(x) ^ f(x ) whenever x G 
(X — 5, Xq + 5) n E. 

(ii) Xq G E is a local minimum if for some 5 > 0, f\x) ^ f(x ) whenever x G 
(x -5, x + S)nE. 

A local maximum or minimum is called a local extremum. If the inequality is strict 
(for x 7^ x ) we will say that the extremum is strict. 

Here is the crucial property (which, of course, you have met before). 

Proposition 12.1 (Fermat's theorem on stationary points). Let f : (a,b) — > R. 
Suppose that x G (a, b) is a local extremum and f is differentiable at x . Then 

f'M = o. 

Proof. If Xq is a local maximum, then there exists 5 > such that whenever < 
x — x < 5 and x G (a, b), 

f{x) ~ f{Xo) < so that 

X — Xq 

/+(^o) = l jm ^ 0. 

x^x + X — Xq 
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On the other hand, whenever — 8 < x — x < and x G (a, b), 

f(x) - /(so) 



X — Xq 



> so that 



x-*-x - X — Xq 

Since / is differentiable at x , f'(x ) = f'_(x ) = f' + (x ) and hence f'(x ) = 0. 
Similarly if so is a local minimum. □ 
Remark 12.2. It is essential that the interval (a,b) is open. Why? 

12.2 Rolle's Theorem 

Theorem 12.3 (Rolle, 1691). Let f : [a, b] — > R be continuous on [a,b], and differen- 
tiable on (a,b). Suppose further that f(a) = f{b). Then there exists a point £ G (a,b) 
such that /'(£) = 0. 

Proof If / is constant in [a, 6], then /'(x) = for every x G (a, 6), so that any point- 
say £ = | (a + b) — will do. 

As / is continuous on [a, b] it attains its maximum and minimum on [a, b] (by Theorems 
4.1 and 4.4). As /(a) = /(&), either / is constant and we are done, or else the maximum 
or the minimum lies in the open interval (a, b). Suppose that £ G (a, b) gives either 
the maximum or minimum. Then it is a local extremum, and by Fermat's result 

f'(0 = 0. □ 

We can express this informally by saying 

'between any two roots of f there is a root of f '. 

Note 12.4. (i) Remember that f is differentiable implies that f is continuous. Thus 
the hypotheses of Rolle would be satisfied if f was differentiable on [a,b] and f(a) = 
f(b). However, often it is important that Rolle holds under the given weaker conditions. 

(ii) When using these theorems remember to check ALL conditions including the conti- 
nuity and differentiability conditions. For example f : [—1, 1] — > R given by f(x) = \x\ 
satisfies all conditions of Rolle except that f is not differentiable at x = 0. But there 
is no £ such that /'(£) = 0. 



12.3 The Mean Value Theorem 

This is one of the most important results in this course. It is a rotated version of 
Rolle. 11 

11 If in an examination you are asked to prove the Mean Value Theorem, then you need to provide 
also proofs of Fermat's result and Rolle's Theorem. 
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Theorem 12.5 (MVT). Let f : [a, b] — > R be continuous on [a,b], and differentiable 
on (a,b). Then there exists a point £ G suc/i i/ia£ 



f(b)-f(a) = f'(t)(b-a). 

Proof. Apply Rolle's theorem to the function 

F(x)=f(x)-k(x-a), 

where A; is a constant to be determined. F : [a, 6] — >■ R is continuous, and is dif- 

f(b} fici] 

ferentiable on (a, b). We choose k so that F(a) = F(b), that is k — . 

CL 

Thus Rolle's theorem applies, so for some number £ G (a, 6), = 0. But F'(x) = 

fix) - k, so f'(£) —k— - f ^ , as required. □ 

o — a 

Note 12.6. Suppose we have the hypotheses of the MVT. Then for any a ^ ai < b\ ^ b 
we can apply the MVT to f restricted to [ai,&i] and get 

f(bi) - /(ai) = /'(d)(6i - ai) /or some & e (ai, 6i). 
A^oie that (for a given function f) the value of £i may depend on a x and b\. 

Corollary 12.7 (Taylor's Theorem, mark 1). Suppose that we have the hypotheses of 
the MVT and that x,x + h G [a, 6] . Then 

f(x + h)- f(x) = f'(x + 6h)h for some 9 e (0, 1). 

Proof. Suppose h < 0; then a^x + h<x^b. From the MVT applied to / on the 
interval [x + h, x] there exists £ G (x + h, x) such that 

f(x)-f(x + h) = f(0(-h). 

Write £ = x + 9h, and note that x + h < x + 9h < x implies — as h < — that < 9 < 1. 
The cases h — and h > are left as exercises. □ 



12.4 A Function with Zero Derivative is Constant 

Here is one of the most useful consequences of the MVT. 

Corollary 12.8 (Constancy Theorem - A function with zero derivative is constant). 
Let f : (a, b) — > R be differentiable, and satisfy f'{t) = for all t G (a, 6). Then f is 
constant on (a, b) . 
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Proof. Apply MVT to / on [x, y] where x, y are any two points in (a, b). (Note that / 
is differentiable on (a, b) implies that / is continuous on (a, b) and hence / is continuous 
on [x,y].) Then f(x) - f(y) = f'(ti)(x-y) for some f e (x,y). But /'(C) = 0, so that 
f(x) = f(y). Therefore / is constant in (a, b). □ 

Note that the interval (a, b) need not be bounded. 

Example 12.1. Suppose that (ft is a function whose derivative is x 2 . Then we have, 
for all x, that <f>(x) = |x 3 + A for some constant A. 

Proof. Let f(x) := <f>(x) — |x 3 ; then / is differentiable and we can calculate that 
f'(x) = x 2 — | ■ 3x 2 = 0. By the Constancy Theorem f(x) = A for some constant A. 
You can justify other 'integrations' similarly . Just guess the 'integral' and proceed as 
above. □ 

Note 12.9. Solutions of differential equations: Last term you learned methods for 
guessing solutions of first and second order linear odes. You were then told that these 
solutions could be used to get the general solution. The Constancy Theorem gives us 
a tool to prove the uniqueness of solutions of DEs and to justify that you did indeed 
have general solutions last term as was claimed (see also Section 13.3). Those who do 
PDEs have already seen this idea this term where you showed that E'(t) = and then 
deduced that E(t) is a constant (which then turned out to be zero). 

Here is a very fundamental example of how we use the MVT to find the general solution 
of a differential equation. 

Example 12.2. Show that the general solution for f'(x) = f(x) for all x G R ; is 
f(x) = Aexp(x) where A is a constant, (i.e. every solution is of this form) 

The 'trick' for solving differential equations is to manipulate them so that they look like 

— F = for some F, and then 'integrate'. This can often be achieved by multiplying 

da; 

by 'integrating factors'. The same 'trick' lets us apply the MVT (or the Constancy 
Theorem) to prove that the solution must be of this form. 

df 

Last term you learnt that to solve the differential equation / = you multiply 

dx 

d 

it by e~f ldx , rewrite it as — (e~ x f(x)) = and deduce that e~ x f(x) = A. 

\XJL 

Now write this as a piece of pure mathematics! 

Consider F{x) := f(x) exp(— x). Then F'(x) = f'(x) exp(— x) — f(x)exp(—x) = 0. 
Hence, by the Constancy Theorem F(x) is constant; that is f(x) exp(— x) = A say, 
and so f(x) = Aexp(x) and all solutions are of this form. 
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12.5 Derivatives and monotonicity 

Corollary 12.10. Let f : (a, b) — > R be differentiable. 

(i) If f'(x) ^ for all x G (a, b) then f is increasing on (a, b). 

Proof: Apply the MVT to any [x,y] C (a,b) to get f(y) - f(x) = f'(£)(y - x), a 
product of non-negative numbers. Hence f(y) ^ f(x) and we are done. 

(ii) If f'(x) ^ for all x G (a, 6) t/ien / decreasing on (a, 6). 

(raj If f'(x) > /or a// x G (a, b) then f is strictly increasing on (a,b). 
(iv) If f'{x) < for all x G (a, b) then f is strictly decreasing on (a, b). 

12.6 The Cauchy Mean Value Theorem 

Sometimes we are concerned with more than one function, and would like to use the 
MVT or a MVT type argument. The following is what we need: except in the most 
trivial cases it never helps to apply the MVT to the functions separately — we generate 
too many distinct £'s. 

Corollary 12.11 (Cauchy's Mean Value Theorem). 12 Let f,g : [a,b] — > R be con- 
tinuous on [a,b] and differentiable on (a, b). Suppose that g'{x) ^ for all x G (a, b). 
Then for some £ G (a, b) we have that 

m _ m - m 

g'(0 9(b) - 9(a) ' 

Proof To be supplied later when we need the result. □ 

13 Applications of the MVT 

Now we have the MVT we can deduce many properties of the exp, log and trig functions 
very easily. 

13.1 Exponential and Logarithm 

Proposition 13.1. exp(x + y) — exp(x) exp(y) for all x,y G R. 

Proof. We will use the Constancy Theorem — but on what function? Fixing y and 
looking at f(x) = exp(x + y) — exp(x) exp(y) leads to /' = / and /(0) = which we 
could now solve to get f(x) = (see section 12.4). 

12 This is where the result belongs logically, but in the lectures it will not appear until later, when 
we do L'Hospital's Rule. 
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However a much better (more direct) way is to fix x + y instead. So, fix c G K, and 
put g(t) = exp c — exp t exp(c — t). Then we have that g'{t) = so that = g(0) by 
the Constancy Theorem. Now g(0) = expc — exp exp c = 0. So for any c,t we have 
that expc — exptexp(c — t) = 0. Put c := (x + y), and £ := x to get the result. □ 

Corollary 13.2. log(wt>) = log(w) + log(f) for all u,v G (0, oo). 

Proof. From above 

exp(log(w) + log(f)) = exp(log(-u)) exp(log(w)) = uv = exp(log(-uf )) 
and take logs. □ 

We can also use the MVT to prove the monotonicity of the exponential function. 
Proposition 13.3. The function exp : R — > (0, oo) is strictly increasing. 

Proof. As exp a; > 0, its derivative is positive. □ 
13.2 Trigonometric Functions 

Proposition 13.4 (The Pythagoras Theorem). For all real x we have that 

cos 2 x + sin 2 x = 1. 

Proof. Let f(x) := cos 2 x + sin 2 x — 1. Then by what we have proved about derivatives 
of trigonometric functions, 

f'(x) = 2 cos x(— sin x) + 2 sin x cos x — = 0. 

for all x. 

By the Constancy Theorem 

f( x ) = /(0) = cos 2 + sin 2 - 1 = (l) 2 -0-1=0. 
as required. □ 
Proposition 13.5 (Addition Formulae). For all real x,y we have that 

(i) cos(x + y) = cos a; cosy — sin x sin 
(ii) sin (x + y) = sin x cosy + cos x sin y. 
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Proof. It is enough to prove one, the other is got by fixing y and taking the derivative 
of the resulting function of x. 

To prove (i) we recall what we did for exponentials: let 

h(x) = cos c — cos x cos(c — x) + sin x sin(c — x) 

whose derivative is 

h'(x) = + sin x cos(c — x) — cos x sin(c — x) + cos x sin(c — rr) — sin x cos(c — x) = 

so that by the Constancy Theorem h(x) = h(c) = 0. □ 

(—\\ k x 2k 

Proposition 13.6. The function cos a; := Y^q — [2k)\ — ° ^ eas ^ : P 0S ^ ve zero which 
we denote (for the moment) by a. 

Proof. First we need to see that there are positive zeros. Note that 

«» =En^r = 1>0 

and (by looking at pairs of terms) 

Ju Ju ^ vC 1 / t/-' \ t/,' t/v 



COS;r 1 2! + 4! ^(4^ + 2)!^ (4fc + 4)(4fc + 3) ) ^ 1 2! + 4! 

provided x 2 < (4+4) (4+3). Asl-fJ + ^ = i [(a; 2 - 6) 2 - 12] we see that cos < 0. 
By the IVT, cosx has at least one zero in [0, \/6]. 
Now let 

S = {t > : cost = 0}. 

Then S ^ and 5 is bounded below, so that a — inf S exists. By definition of inf S, 
given n there exists t n G 5 such that a < t n < a + 1/n. Thus t n — > a as n — > oo. But 
cosx is continuous, so that cost n — > cos a, and hence cos a = 0. But cosO = 1 so that 
a is the minimum positive zero required. □ 

Proposition 13.7. sin a = I. 

Proof. By Pythagoras, sin a = ±1. Suppose sin a; = — 1; then by the MVT there would 

_ . /n . . . sin a — sinO — 1 n TT n , 

be some £ e (0, a) such that cos £ = = — < 0. However, cosO = 1, and 

a — a 

a is the first root, so by the IVT cos£ cannot be negative. □ 
Proposition 13.8 (Periodicity). For all real x we have that 

(i) cos(x + a) = — sinx and sin(x + a) — cosx; 
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(%%) cos(x + 2a) = — cos re and sin(x + 2a) = — smx; 

(Hi) cos(x + 4a) = cosx and sin(x + 4a) = smx. 

(iv) cos(2A;a) = (-1)*; cos((2A; + l)a) = 0; 

sin(2A;a) = 0; sin((2A; + l)a) = (-l) fe , VA; G Z. 

Proof. We just use the addition formula repeatedly, inserting the values cos a = and 
sin a = 1. □ 

Now that we have proved these results, and the danger of using 'obvious' but unproved 
properties of n has passed we can make the following definition: 

Definition 13.1. vr := 2 • inf{t > : cost = 0}(= 2a). 

We need one more result, and then we have established "all" the usual facts about the 
trigonometric functions. 

Proposition 13.9. The zeros of cosx are at precisely the points {(k + 7,)ir : k e Z}. 

Proof. By Proposition 13.8(iv), for fceZ, cos(^7r + kn) = so these are all zeros. If 
j3 is such that cos/3 = then from Proposition 13.8(ii)there exists k G Z such that 
A) — P + kn G (0, 7r] is a zero of cos re. Clearly (3 ft \ix by definition. Using 

C0S(7T — X) = — C0S(— X) = — COs(x) 

we see that if j3o > \ix then n — f3 < \ix is a zero of cosx, which cannot be. Hence 
Po = \n, and P has the required form. □ 

Note that from Proposition 13.8(i) it now follows that the zeros of sinx are precisely 
{kn : k G Z}. 

13.3 Differential Equations 

In Section 12 we already looked at one example. Here is another, but this will not be covered 
in lectures. 

Example 13.1. This example is based on a Calculus question from a Mods Collection. Find 
all solutions of 

(The emphasis for us is on "all".) 
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The following is all motivated by the method for finding a second solution for second-order 
linear ordinary differential equations when one solution is known, which you learnt in the 
'Introductory Calculus' course last term. We use the methods from this course to show that 
these are all the solutions. 

We can check easily that (1 + x 2 ) is a solution; so we write 

/ x y( x ) 

z{x) = rr^- 

An easy calculation yields 

y' = z'{\ + x 2 ) + 2xz and y" = z"(l + x 2 ) + 4xz' + 2z, 
so that z must satisfy 

z"(l + x 2 ) + Axz' = 

and hence 

[z'(l + x 2 ) 2 ]' = {z"(l + x 2 ) + 4xz')(l + x 2 ) = 0. 
By the Constancy Theorem. 

z'(l + x 2 ) 2 = A 

for some constant A and so 

z'{x) 



(1 + x 2 ) 2 ' 

Although of course we can't 'integrate up' yet — we don't know what that means — we can 
take the hint and look at what the integral would be, namely 



w(x) = - 
v ' 2 



x 

arctan x + 



l + x 1 



here arctan is the inverse function of tan. So by the Inverse Function Theorem and the other 
rules of differentiation which we have established we can check that 

W '( X ) = (1 ^2)2 = Z '( X )/ A - 

Hence by the Constancy Theorem z(x) — Aw{x) = B for some constant B, and so the only 
solutions are 

y(x) = — [(1 + x 2 ) arctan x + x] + B(l + x 2 ). 



13.4 The function 

x 

This is a good example of how the Mean Value Theorem and its various corollaries are 
used practically. 

Proposition 13.10. Let < x < \k. Then 
(i) sinx < x < tanx and so cosx < < 1; 
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(ii) lim^o ^ = 1; 
(mj | < < 1 (Jordan's inequality). 

We therefore have the following bounds: 

r 2 sin x 
maxjcosx, — } < < 1. 

7T X 

Proof. To prove the first inequality, consider f(x) = tana; — x, for x G [0, \ti). Then 
/ is differentiable on (0, \n) and 

f'(x) = — 1>0 for all x G (0, ^7r). 

cos 2 re z 

Hence / is strictly increasing on [0, |7r); in particular /(x) > /(0) for any x G (0, \n) 
which yields tan x > x. Considering x — sin x in the same way will give x > sin x. 

The second inequality in (i) is got by inverting and multiplying by sinx; this is justified 
since sinx > until the smallest positive zero of cosx. 

For (ii) we use a version of the sandwich theorem and the continuity of cosx to get 
that lim a; _ i ,o+ exists and 

sinx 

1 = hm cosx ^ hm ^ 1. 

x^0+ x^0+ X 

. sinx . . . sinx 
As is an even function this gives that hm^o = 1. 

x x 

Now consider 

/ \ sin x /in 
n(x) = for x G (0, |7rJ. 

Then 

,,. . cosxfx — tanx) „ . , , 

h'(x) = K — < for all x G 0, ±tt 

x 2 A 

so that /i is strictly decreasing, and hence h(x) > h(^ir) for any x G (0, |tt); this gives 
the first inequality of (iii). The second is already included in (i). 

□ 



14 L'Hopital's Rule 



This section is devoted to a variety of rules and techniques for calculating limits of 
quotients. They derive from results of Guillaume de l'Hopital; perhaps they are really 
due to Johann Bernoulli whose lecture notes l'Hopital published in 1696. 
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14.1 The Cauchy Mean Value Theorem 



As promised earlier here is the proof of Cauchy's symmetric form of the MVT. (At first 
sight one might think we could just apply the MVT to / and g separately. However, 
a moment's reflection will show that we would then get two different £.) 

Theorem 14.1 (Cauchy's Mean Value Theorem). Let f,g : [a, b] — >■ R be continuous 
on [a,b] and differentiable on (a,b). Suppose that g'{x) ^ for all x G (a, b). Then 
for some £ G (a, b) we have that 

f(0 f(b) - /(a) 



9'(0 gib) - g(a) 



Proof. First, this makes sense: we cannot have g(b) — g(a) 
there would be a point r] G (a, b) with g'{rj) = 0. 

Now let the function F be defined on [a, b] by 



or by Rolle's Theorem 



F(x) 



1 1 1 

/(*) /(«) 
g(x) g(a) gib) 



that is 



F(x) = (f(a)g(b) - f(b)g(a)) + f(x) (g(a) - g(b)) + g(x) (f(b) - f(a)) 

which, being a linear combination of / and g is continuous on [a, b] and differentiable 
on (a,b). Clearly F(a) = F(b) = 0; so Rolle's Theorem applies and yields a £ G (a, &) 
such that = 0. But 

= F'(0 = + /'(0 ( ff (a) - (,(&)) + </(0 " /(a)) 
and we are done after dividing by the non-zero g'(£)(g(b) — g(a)). □ 



14.2 The L'Hopital Rule 

Proposition 14.2. Suppose f, g are continuous on [a, a + 5} (for some 5 > 0), and 
differentiable in (a, a + 5), and that /(a) = g(a) = 0. Suppose further that I := 

f'(x) 

hm, r _ s . a+ -^T^y exists. 
Then 

lim 44 = lim 

a;^a+ g[x) x^a+ g'(x) 

Proof. Note that there must exist a 5' < 5 such that on (a, a + 5'] we have that 
g'(x) 7^ 0, for otherwise the function f'(x)/g'(x) would not be defined near a and so 
this limit could not be defined. 
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For every x G (a,a + 5'), apply Cauchy's MVT to /, g on the interval [a,x]: there is 
£c G (a, x) such that 

/(x) _ f{x) - f(a) _ /'(&) 
g(x) g(x) - g(a) g'(£ x ) ' 

But if x — > a+, then £ x — > a with £ x > a, so that 



Hence 



lim A— r = lim 



□ 



Similarly we prove 

Corollary 14.3. Suppose f, g are continuous on [a — 5, a] (for some 5 > 0), and 
differentiate in (a — 5, a), and that /(a) = g(a) = 0. Suppose further that I := 
lirn^a. ^T^y exists. Then 

x^>a- g[x) x^a- g'{X) 



The proof of the following is now immediate. 

Corollary 14.4 (L'Hopital's Rule (L'HR)). Suppose f, g are continuous on [a— 5, a+5] 
(for some 5 > 0), and differentiate in (a — 5, a + 5) \ {a}, and that /(a) = g(a) = 0. 
Suppose further that I := lim^a exists. Then 

9 \X) 

x^a g[x) x^ta g'[x) 

Note 14.5. Sometimes this is called the jj case of L'HR. 



14.3 Some Applications 
Example 14.1. Prove that 

.. 1 — cos a; 1 
hm = -. 

z-s-o x 2 2 

We argue like this: 
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1 — COS CC Sill X 

lim = lim by L'HR, provided this limit exists 

x-i-0 X 2 x^O 2x 

COS X 

= lim — - — by L'HR, provided this limit exists 
x-^>o 2 

= - and this limit exists by the continuity of cos a;; 
so the above equalities hold. 



To justify all this we need to check L'HR, which we have used twice is actually appli- 
cable. But by standard results we have already proved: 

1 — cosrr and x 2 are continuous on [— |7r, |7r], zero at zero, and differentiable on 



|7r, |7r) \ {0} with derivatives sin a; and 2x; 
sin a;, and 2x are continuous on [— |7r], zero at zero, and differentiable on ( ^7r, |7r) \ 
{0} with derivatives cos a; and 2 



Note that this proves incidentally that lim^o ^f- = 1. 



Example 14.2. 



lim I0g(1 + X) = 1. 

x->0 x 



Again we argue: 

lim lQg(1 + :g) 

no x 



log'fl + x) 

= lim by L'HR, provided this limit exists 

x~>0 X 

= lim derivative of log t is - 

x^Ol + x t 

1 



= 1 by continuity of 

1 + x 

—as this exists previous equalities hold. 



To justify the use of L'HR we need to see that log(l + x) and x are continuous on 
[— |, |], at 0, and differentiable on (— |, |) \ {0}. 



Example 14.3. 



lim(l + x) * = e. 

x^O 



Recall that by definition (1 + x)* : = exp (| log(l + x)). So consider first log (* +a: ) . By 
the previous example this has limit 1. Now by the continuity of exp (a;) we see that 

/ \i /l°g(l + X )\ / N 

(1 + x) * = exp I I — > exp(l) = e as x — > 0. 
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14.4 L'Hopital's Rule: infinite limits 



If we have all the hypotheses for L'Hopital's rule, except that we have 

— — — — y +00 as x — y a 
g'(x) 

then we swap / and g, then use L'HR and conclude that 




— y as i4a. 



14.5 L'Hopital's Rule at 00 

Proposition 14.6. Suppose /, g : (a, +00) — y K. are continuous and differentiable, 
with f(x) — y and g{x) — >■ as x — >■ 00. If g'(x) ^ on (a, +00) and — > Z as 

x — > 00, then lim^oo = I. 

Sketch proof: Put y — - soy— y as x — y 00. Then apply L'HR to the functions 
F(y) = /(i) and G(y) = a(J), with F(0) = = G(0), checking carefully that the 
hypotheses hold. 



14.6 L'Hopital's Rule— the g case 



There is one important variant which we cannot obtain by algebraic manipulation, or 
by taking logarithms or exponentials or similar tricks. The proof will probably not be 
covered in the lectures. 

Proposition 14.7 (L'HR, the ^ case). Let f,g:(a,a + 5)^Rbe differentiable for 
some 5 > 0. Suppose further that f(x) — y 00 and g(x) — >■ 00 as x — >■ a+ and taat 
' im i^a+ ^7(^y exists. 

Then 

.im M = nm m. 

Note 14.8. We do not want to make too much heavy weather in this proof; checking all the 
details is a good exercise. 

Proof. Write K := lim^^ai Let e > 0, then there exists a 5\ > such that 61 < S and 



<?'(*) ' 
/'(*) 



o'(x) 

Now fix some c in (a, a + <5i). 



K 



< he for all x G (a, a + <5i). 
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For any x G (a, c) we apply Cauchy's MVT to /, g on [x, c]: there is a number £ x G (x,c) 
such that 

/(c) - /(g) = f(e a ) 

g(c) - g(x) g'(£ x ) ' 
Since £ x G (x, c) C (a, a + <5i), we have that 



/(*) - m 



g(x) - g{c) 



-K 



nix) 



g'(ix) 



- K 



< he for all x G (a, c). 



(Unlike the jj case we cannot conclude immediately that — >■ K as x — > a+ (although 
it does !!), as there is no guarantee that £ x will tend to a as x — > a+). 

Clearing the fraction we have that 

\f(x) - /(c) - Kg(x) + Kg(c)\ < \e \g(x) - g(c)\ 

so that the Triangle Law gives us 

- Kg(x)\ < \e \g(x) - g(c)\ + |/(c) - Kg(c)\ 

or, provided g(x) / 



f(x) 



g{x) 



K 



< ¥ 



9(c) 



9{x) 



|/(c) - Kg{c) 
\9{x)\ 



Now use the fact that g(x) — > oo; we can find a S2 > 0, such that S2 < Si and such that for 
a < x < a + S2, g(x) / 0, 



1 



9(c) 



g(x) 



<§ and 



so that we have 



as required. 



/(*) 



g(x) 



-K 



□ 



14.7 More applications 

These examples might be better done by using the standard limit from Analysis I that, 
if a > 0, x exp(-ax) — » as x — > 00 . 

Example 14.4. \im x ^ +OD ^ = for any fi > 0. 

Let g(:r) = x^ = exp(/zlogx). Then (/(re) = fix 11 ' 1 . So by L'Hopital's rule (^ case) 
we have 

log x ~ 
lim = lim — - — - provided this limit exists 

X^ x^+oo fJLX^ 1 

= lim = which does exist. 

x^+00 fix^ 
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Example 14.5. For any /jl > 0, lim x _ 5>0 + x^ log x = . 
We transform this into — form and then by L'HR 
lim x M log x = lim — — 

= lim — ^— -. if this limit exists 



= lim 

i-s-o+ (— ^x^" 1 x ^o+ (— /i) 



lim 



x 



which does exist. 



Finally 

Example 14.6. Show that 



i i 

}j m ( sin x \ l—cosx — g~ 3 
„.^n V a; / 



Since f(x) = (^f 1 ) 1 - cosx is an even function, we only need to show that lmx r _> + /(x) 
e~s. According to the definition 

1 



/(*) 



By the L'Hopital Rule, 
log sin x — log x 



lim 

i->0+0 



COS X 



exp 
exp 



log 



SIM 



1 — COS X X 

log sin x — log x 

1 — cosx 



= lim 



cos x 1 SlU X 

11 ' ' [provided it exists; recall > 1] 



x^>o+ sin x 

, . x cos x — sin x 

lim 2 

x^o+ xsin x 

cos x — x sin x — cos a; 

lim 2 

a;->o+ sin x + 2x sin x cos x 

X 



X 



lim 



a;^o+ sin x + 2x cos a; 
— lim 



x^o+ cos x + 2 cos x — 2x sin x 
- [continuity] . 



[if it exists, using L'Hopital] 



[if it exists, using L'Hopital] 



Finally, since exp is continuous at 



3' 



lim 



sinx\ 1 - cosx / log sin x — log x 

= lim exp 

X / x^0+ V 1 — cos X 



= exp 



[by continuity of exp] . 
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14.8 Health Warning 



L'Hopital's Rule is very seductive. But it is often not the best way to evaluate limits. 
Taylor's Theorem, to which we turn next, is often more useful, and indeed more 
informative. 

sinh x^ — x^ 

If you doubt this, then use L'HR to work out lim^o j- , and then later use 

(x — sinx) 

Taylor's Theorem to write it down at sight — and decide which is better. 



15 Taylor's Theorem 
15.1 Motivation 

Suppose that / : (a — 5, a + 5) — > K. and that for some n ^ 1 the derivatives /', /", 
. . . , exist on the interval. For convenience write f° := f. 

We can then form the Taylor polynomials 

f"(a) fW(a) 
P n (x) := f(a) + f(a)(x - a) + LL1( X _ a f + . . . + J -^(x - a) n 

a polynomial of degree n in x. This polynomial 'agrees with /' to the extent that 
pi k \a) = f( k \ a ) for k = 0,...,n. 

We have 

Pq(x) = f(a) constant approximation, not very interesting; 
Pi ( x ) — f( a ) + f'( a )( x — a ) linear approximation; 

f"( a ) 

P 2 ( a; ) = /(a) + f'( a )( x — a ) H ^ — ( x — a) 2 quadratic approximation; 

and so on. 

We might hope, on the basis of our experience, that P n (x) is a good approximation to 
f(x); we would like to investigate that intuition. 

We will also consider the power series 

P(x):=jr f -^(x-a) k 

k=0 

which is called the Taylor expansion of / at a. Our previous experience leads us to 
conjecture that this must equal f(x). 

To investigate these questions we will look at the 'error term' 

E n {x) := f(x) - P n (x). 
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(Clearly, if / has derivatives of all orders, P n {x) — > f(x) as n — > oo if and only if 
E n (x) —f 0.) Unfortunately, even if / has derivatives of all orders, it need not be true 
that E n {x) — > as n — > oo, so we have to move more carefully. First, we will prove 
Taylor's Theorem which will give us information about E n {x). Secondly, in individual 
cases we have to consider whether E n (x) — > as n — > oo. 



15.2 A cautionary example 

Our intuition, built on experience of polynomials, trigonometric and exponential func- 
tions, is misleading. The following example shows us that there are functions f(x), 

with derivatives of all orders at every point of K, such that Yl ^~^~ xk * s convergent for 
every x — but for which E n (x) -/> 0. 



Consider / : R — > ffi. defined by 

/(*) = 



exp(— \) whenever x ^ 0, 
for x = 0. 

Some experimentation shows that we expect 

f(*)M = / ex P(^^) whenever x ^ 0, 

1 w \ for x = 0, 

for some polynomial Qk of degree 3k. We can prove this by induction: At points 

this is routine use of linearity, the product rule and the chain rule. But at x = we 

need to take more care, and use the definition: 

/'"(*) -/'"(Q) = i Qt (I) exp (_L) = y y*p(-?> 

x — x V ^ / \ x 2 J ^ x s 



which we must prove tends to zero as x — > 0; if we change the variable to t — - then 
we have a finite sum of terms like t s exp —t 2 which we know tend to zero as \t\ tends 
to infinity. 

So for this function / the series - ^^° x k = so converges to at every x. But the 
error term E n (x) is the same for all n (it equals f(x)) and so does not tend to at 
any point except 0. 

Note that we can add this function to exp a; and sinx and so on, and get functions 
with the same set of derivatives at as these functions, so that they will have the same 
Taylor polynomials — but are different functions. 

Remark 15.1. Functions defined and differentiable on C are very different: for them, 
our naive intuition is a good guide — but that is next year's Analysis course. 
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15.3 Taylor's Theorem with Lagrange Remainder 

We now concentrate on the Taylor polynomial and investigate its difference from the 
function. 

Theorem 15.2 (Taylor's Theorem). Let f : [a,b] — > HL Suppose that for some n ^ 1 
we have that f , /', /", . . . , /( n_1 ) exist and are continuous on [a, b] and that exists 
on (a, b). 

Then there is a number £ G (a, b) such that 

m = g f^M {b _ a f + 1^1 {b _ a) « (Tn) . 

fc=0 



Note 15.3. Recall that at the end points a andb 'differentiable' means 'left- (or right-) 
differentiable. 

Note 15.4. The term (b — a) n is called Lagrange's form of the remainder. Note 

that the crucial parameter £ ; may depend on (i) the function f ; (ii) the degree n; (Hi) 
the end points a and b. 13 

Note 15.5. // we set b — a = h, then Taylor's theorem may be stated as 

k=0 

where 9 is some number between and 1. 

Proof. We use the method of "varying a constant": Consider F : [a, b] — > R 

F(*):=£^(6-»)». 

fc=0 

F is clearly continuous on [a, b] and on (a, 6) we have that 

nx) _ g» (6 _^ + g/^£) ( _ 1)M6 _ ir 

fc=0 fc=0 

J ^(^-1)! (n-1)! 1 Xj 

Note also that F(a) = Y? k Zl ^p 1 (6 - a) k and F(6) = /(ft). 



n-l 



13 When applying Taylor's Theorem to different functions (perhaps as similar as f(x) and f(—x)) 
or different ranges (perhaps as similar as [0,6] and [—6,0]) it is essential to use a different letter for 
each £ that is introduced. 
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Let G(x) be continuous on [a, b] and differentiable on (a,b). We use Cauchy's Mean 
Value Theorem on this pair of functions to see that there exists a £ G (a, b) such that 

F(q) - F(b) _ F'(Q 
G(a)-G(b) G'(0" 

That is 



Efc= fci ( fe ~ a ) T^TJT^ U 



G(a) - G(6) G'(0 

But if we take 

G(x) := (b-x) n , 

which is clearly continuous on [a, b] and differentiable on (a, b) with derivative 
— n(b — x)^ 1 < 0, then (*) simplifies at once to 

k=0 



□ 



Note that, under the conditions given above, we can replace b in (T n ) by any x G [a, 6]. 

We have proved the strongest theorem we could. But often we know a bit more, and 
can get, for example this symmetric version: 

Corollary 15.6 (Taylor's Theorem). Let f : (a — 5, a + 5) — > R for some 5 > 0. 
Suppose that for some n ^ 1 we have that /', /", . . . , exzsi. Lei rr G (a — 5, a + $). 
Then there is a number £ between a and x such that 

k=0 

Proof. If x > a then this is just the Taylor Theorem we have proved. If x < a we just 
use the Taylor Theorem we have proved on the function f(—x). If x = a then take 
£ = a (we define 0° := 1 - see also Section 16.3). □ 



15.4 Other forms of the remainder 

In the proof of Taylor's Theorem we may use any function G which is continuous in 
[a, b], differentiable in (a, b), and such that G' ^ 0. Then we will have a £ G (a, b) such 
that 

fib) = + ^-^ (b - o G , (0 . 
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By choosing different functions G, you may prove Taylor's Theorem with the remainder 
of different forms. For example, if we choose G{x) = x — a, then G( -^J^ (a - ) = b — a. 
Thus 

fib) = P n _!(6) + j^Yy(b - a) (6 - 0" for some f G (a, 6). 

Exercise 15.1. Try Gr(x) — (x — a) m for a power m ^ 1 to see what kind of Taylor's 
formula you can get. 



15.5 The error estimate 

Taylor's Theorem also provides us with an explicit estimate of the difference between 
f(x) and its n- Taylor approximation Ylk=l ^ k\°^ ( x ~ a ) k '- 

Corollary 15.7. Let f : [a, b] — > R satisfy the conditions in Taylor's Theorem, and 
fet£„:=^sup £€W) |/M(fl|. Then 



k=0 



^ /or a// x G [a, 6] . 



Of course this may not be useful, as the supremum may be infinite. If however in a 
given situation we know a bit more — for example, that f^ is differentiate on [a, b] 
then we can use standard calculus to evaluate E n . 



15.6 Example: the function log(l + x) 

By way of an example we prove the following: 
Proposition 15.8. We have 



log(l +x) = X^- 1 )"" 1 ^ f° r aU x e ( -1 > 1 1" 



n=l 



Note that this is the best result we can get as the radius of convergence of the series 
is by the ratio test equal to 1 and at the other end point x — — 1 the series is the 
notoriously divergent Harmonic Series ^2 K 

But we will prove equality on all of (—1, 1], in particular that log 2 = Y^=i — • 

Proof. Consider f(x) = log(l + x). We have already proved that on (— l,oo) the 
function / is differentiate with f'(x) = and so, by induction we have f^ n \x) = 

( - 1 {;;^T 1)! for all n > 1. 
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Hence, by Taylor's Theorem (the symmetric version) 

^zi C_i \k-i„k i 

io g (i+^)-E - fc =(~ 1 ) n ' 



^=1 



X 



n \ 1 + f r , 



for some £ n between and x. 

To get our result it would be enough to show that 



x 



€ 1 



for every n and x G (—1, 1]. 

For x > this is no problem, < £ n < 1 and so 1 + £ n > 1; hence -r^- < x ^ 1. 

For negative x it is not so easy; the nearer x is to — 1 the nearer 1 + £ n may get to 0. 
However, if x ^ — | we have 

and so 

which implies 



2a; < 



1 + 



< x. 



Now 2x > —1 and x ^ 1 so we have 



x 



€ 1 



as required. 

That is, the functions log(l + x) and YlT=i(~ l) fc_1 ir are equal on [— |, 1]. 
What about (— 1, — |)? We must use a very different argument. 

Consider the functions f(x) = log(l + x) and g(x) = l^^ir on (—1,1). 

Both are differentiable there; we have proved f'(x) = , and by the theorem on 
term-by-term differentiation of power series 

00 „.fc-i 00 i 

</(*) = £(-i) fe ^ V = B- 1 )* -1 ** -1 = r 



+ X 



k=l k=l 

Hence f'(x) — g'(x) =0, so by the Constancy Theorem, 

f(x)-g(x)=f(0)-g(0) = 0. 

That is, on the whole of (—1,1] we have the required series expansion. 



□ 



Remark 15.9. The last part has actually proved the result for x e (—1, 1). It is only 
at x = 1 that we have to prove that the error tends to zero. 
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16 The Binomial Theorem 



In this section we use many of the theorems we have proved about uniform convergence 
and continuity, power series, monotonicity as well as Taylor's Theorem. As well as 
proving an important result we are showing off the techniques we now have available 
to us. 



16.1 Motivation and Preliminary Algebra 

By simple induction we can prove that for any natural number n (including 0) we have 
for all real or complex x that 

k=n / \ 

(i+*)" = EuK; 

k=o ^ ' 

where the coefficient of x k can be proved to be 

'n\ n\ n ■ (n — 1) (n — k + 1) 

k) = k\(n-k)\ = k ■ (k — 1) 1 ' 

We have also seen in our work on sequences and series that 

oo 

(l + x)- 1 = J2(-l) k x k for all |x| < 1 

k=0 

and here the coefficient of x k can be written as 

( ])k _ (-!)• 

1 ' k-(k-l) 1 ' 

and we can prove by induction (for example using differentiation term by term) that 
for all natural numbers n ^ 1 we have that 

(i + *r = E { ~ n) ' { ~l7(k-i)'. { ~ n i k+l)) xk for a11 1x1 < x > 

k=0 ' \ ' 

so the binomial theorem above holds for all integers n. 

In this section we are going to generalise these — in the case of some real values of 
x — to all values of n, not just integers. Note that this is altogether deeper: (1 + x) p is 
defined for non-integral p, and for (real) x > —1, to be the function exp(plog(l + x)). 

Definition 16.1. For all p e K and all k G N we extend the definition of binomial 
coefficient as follows: 

P ) := 1; and ( f) := P{P - ^ ' ' ' [ P - k - + 1} . 
0/ ' \k k\ 
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We now make sure that the key properties of binomial coefficients are still true in this 
more general setting. 

Lemma 16.1. 

Proof. If fc — 1 then by the definition we must see 1 • j = p • 1 which is clear. Otherwise 
iJp\ _ v Ap - 1) • • • (P - fc + 1) _ (p - 1) . . . (p - fc + 1) _ 

a " p (fc^i)! ~ p {k-i 



Lemma 16.2. 

Proof. When fc = 1 we must prove ^ + 1 = ^ which is clear. Otherwise 

p\ / p \ p(p — 1) . . . (p — fc + 1) p(p — 1) . . . (p — fc + 2) 



kj \k-lj fc! (fc-1) 

= P 0>-l)..^-t + 2) [(p _ t+1) + tl 

(p+l)p(p-l)...(p-fc + 2) 

~ fc! 
P+ 1 N 
fc 



16.2 The Real Binomial Theorem 

Theorem 16.3 (The Binomial Expansion). Let p be a real number. Then 



V /or a// |x| < 1 (£). 



□ 



□ 



Note that the coefficients are all non-zero provided p is not a natural number or zero; 
as we have a proof of the expansion in that case we may assume that p ^ N U {0}. 

Lemma 16.4. The function f defined on (—1, 1) by f(x) := (1 +x) p is differentiate, 
and satisfies (1 + x)f'(x) = pf(x). Also, /(0) = 1. 
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Proof. The derivative is easily got by the chain rule from the definition of /; it is 
f'(x) = p(l + xY' 1 . Multiply by (1 + x) and get the required relationship. The value 
at is clear. □ 

Lemma 16.5. The radius of convergence ofY^kLo (k) xk is R — 1. 

Proof. Use the ratio test; we have that u \ak+\X k+1 /a k x k \" is 
p ■ (p - 1) (p - k) k ■ (k - 1) 1 



(k + 1) -k- (k-1) 1 p-(p-l) 

as k — > oo. 



(p-k + iy 





p — k 






k + 1 


—7- \X\ 



□ 



Lemma 16.6. The function g defined on (—1, 1) by g(x) = YlkLo (k) xk ^ differen- 
tiable, with derivative satisfying (1 + x)g\x) = pg(x). Also, g(0) = 1. 



Proof. 

(l + x)g'(x) 



00 / \ 

(1 + x) ( J kx k ~ l , differentiation term by term valid for \x\ < 1, 

A;=0 ^ ' 

°° f \ 

(i+*>E 

p(l + x) ( j) 2 ^ 1 by Lemma 16.1 

g(r>-' + E(r>} 

e p :V+e 



,m=0 



m=l 



P — 1 

m — 1 



m=l 

oo 



P — 1 

m 



=pWE 

m=l 

oo 



m=l 

m / V m — 1 



p — 1 
m — 1 



m=l 

oo 



by Lemma 16.2 



m=0 

= pg(x). 



P >x™ 

m. 



□ 
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Q\ X ) 

Proof of the Binomial Theorem. Consider (f>(x) = , which is well-defined on (—1, 1) 

/ \ x ) 

as f(x) > 0. By the Quotient Rule we can calculate 4>'(x), and then use the lemmas: 

_ f{x)g'(x) - f'{x)g(x) p f{x)g{x) - f{x)g{x) _ 
9[) f{xf 1 + x f{xf 

Hence by the Constancy Theorem, <f>(x) is constant, <f>(x) = 0(0) = 1. This implies 
that f(x) = g(x) on (-1, 1). □ 



16.3 The end points: preliminary issue 

The existence of these functions and their equality at the end points requires more sophisti- 
cated argument. Most of the following will probably be omitted from the lectures but in any 
case the following sections should be viewed as illustrations of the way Taylor's 
Theorem can be exploited, rather than theorems to be learnt. 

The cases x = lorx = — 1 need to be considered separately. But there is a difference 
between these! 

For x = — 1 we have not yet defined (1 + x) p . 

For p e N we have the usual algebraic definition, so P = 0. Can we define P sensibly for 
any other values of pi 

For p > 0: If x > — 1 we defined (1 + x) p := expplog(l + x). As log(l + x) — >■ — oo as x — > — 1, 
we have expplog(l + x) — > as x — > —1. Thus to make (1 + x) p continuous at x = — 1 we 
should define P = 0. This we now do. 

If p = 0: How one defines 0° depends on the context. (Sometimes 0° := 1 sometimes 0° := 0.) 
If (B) is to hold for x = then we must define 0° = 1. But if we do this , then to preserve the 
rule of exponents A p A q = A p+q we cannot define negative powers; if p > then 0~ p makes 
no sense. 

So let us extend out definition of (1 + x) p in this way, in the case when p > 0. 
But we need to take care. 

Lemma 16.7. If p > then the function (1 + x) p is continuous on [— l,oo). 

Lemma 16.8. If p > 1 then the function (l + x) p is differ entiable on [— l,oo) with derivative 
p(l + x) p - 1 . 

Proofs. Exercises. □ 



16.4 The end points: p ^ — 1 

Let p ^ — 1. Then as remarked above, the function (l + x) p is not defined at x = — 1. Further 
the expansion does not converge at x = 1: 
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Proposition 16.9. The series YlkLo 



p ■ (p — 1) (p — k + 1) 



fc-(fc-l) 



is divergent. 



Proof. Write q = — p ^ 1; then the modulus of the fc-th term 



P • (p - 1) (p — k + l) 



k ■ (k — 1) 1 



(-1) 



k q q + s q + k-l 
1 "' s + 1 



A; 



^ 1; 



the terms alternate in sign but as they do not tend to the series diverges. 



□ 



16.5 The end points: — 1 < p < 



Let — 1 < p < 0; note that p + 1 > 0. Again the function (1 + x) p is not defined at x = — 1. 
However, now the expansion converges at x = 1: 

Proposition 16.10. The series YlT=o ~ — ~i — 77 N — — 7 — ^ is convergent with sum 



2 p . 



k-(k-l) 1 



Proof. We apply Taylor's Theorem to (1 + x) p on the interval [0, 1] and find, for each n ^ 1, 
a point G (0, 1) such that 



n-1 



2^ = ^^fc^^ + i? n 



fc=0 



fc- (ife-l) 1 



where 



We have then that 



p P " (p ~ 1 ) (g ~ n ± x ) n j.* 

= 7 7T : l-L + ?nJ • 

n • [n — 1) 1 

p ■ (p — 1) (p — n + 1) 



n • (n — 1) 1 

and we will have the result if we prove that this tends to as n — > 00. We rewrite \E n \ as 

l(?> + i)-i] Vp+i) -«]■■•• [0> +!)-»] 



i-?±i|.|i 



1-2 n 

p+ 1' 



1 p + l\ A p+i 



n 



Now exp(— x) + x — 1 has positive derivative on (0, 1) so by the MVT we have that 

' P+ l \ ^ ( P+ 1 
1 I ^ exp 



so that 



\E n \ ^exp ^-( p+ l)J2^j 



As the harmonic series diverges and (p + 1) > 0, we get that E n — > as n — > 00. 



□ 



81 



16.6 The end points: < p 



Let < p. In this case the expansion is valid at x = 1 and x = — 1. 



Proposition 16.11. T/ie series J2t=o 



p ■ (p - 1) 



(p - fc + 1) 



2 P ; and £/te series J2T= 



k-(k-l 
p ■ (p — 1) (p — fc + 1 



is convergent with sum 



k-(k-l) 



(— 1) is convergent with sum 0. 



Proof. The end point x = +1 is straightforward; use Taylor's Theorem as before and consider 
the error estimate 



for some £ n G (0, 1). Then 



n • (n — 1) 
(p-1). 



n 



(p — n + 1) 



1 • 2 



(n-1) 



2 p 



Now 



^ 1 whenever 2s ^ p; so we get that 
(P-1) (P-[f] 



| -En | ^ 



P 



n 



1 • 2 



([!]) 



2 p 



—7-0 as n 



oo 



as required. The end point x = — 1 is more difficult. What we do is prove that the sum 



of power series ^ 



converges. Noting that as soon as k ^ p + 1 all the terms have the same sign, we see that 
this means we have proved that the series is absolutely convergent. Now by the properties 

VX) P ■ (P - 1) (P - k + !) k ■ U I x 1 x / 1 1 \ T 

x is absolutely convergent on ( — 1, 1). In 

k ■ (k — 1) 1 

particular we have that the series is absolutely convergent on the closed interval [—1,0]. 
Hence the series is uniformly convergent on that interval; and so the series is continuous 
on [—1,0]. As the series is equal to (1 + x) p on (—1,0] we have by continuity that there is 
equality at —1 as well. 

So we must prove that the series converges. We claim that if we can prove this for any p then 

p + 1 

we can prove it for (p+l). This is because for all n ^ 2p+2 we have that ^ 1; this 

p — n + 1 

allows us to compare the n-th terms and see that those for (p + l) are smaller in modulus. As 
both series are ultimately the series of terms of constant sign, the comparison test will yield 
that convergence for p yields convergence for (p+l). So assume from now that < p < 1; 
it will suffice to deal with this case. 

The modulus of the n-th term can then be written 



n 
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and so, using again (1 — t) ^ exp(— t), we have that 

= exp I -p I ^2 - ~ logn exp (-p(logn)) 



n— 1 

\u n \ <-exp 

n \ ' s 

s=l 
fn-\ 



. / /n— 1 

p 1 



Now we have (Integral Test argument) that 

n-l 



^ logn — >■ 7 as n — > oo (7 is Euler's constant). 



s=l S 

Hence we have a constant C such that 

\u n \ < C — - — for sufficiently large n, 
n ■ nP 

and so, by the Comparison Test, ^ |it n | converges. 14 

□ 



^2 ^ is convergent for s > 1 by the Integral Test. 



83 



